-- Logs begin at Tue 2022-10-18 23:51:38 UTC, end at Wed 2022-10-19 00:56:14 UTC. -- Oct 19 00:30:51.115084 dv-cinder-master-3-smb systemd[1]: Starting Devstack devstack@n-api.service... Oct 19 00:30:51.122984 dv-cinder-master-3-smb devstack@n-api.service[110499]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 19 00:30:51.127835 dv-cinder-master-3-smb devstack@n-api.service[110499]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 19 00:30:51 2022] *** Oct 19 00:30:51.127835 dv-cinder-master-3-smb devstack@n-api.service[110499]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 19 00:30:51.127835 dv-cinder-master-3-smb devstack@n-api.service[110499]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 19 00:30:51.127835 dv-cinder-master-3-smb devstack@n-api.service[110499]: nodename: dv-cinder-master-3-smb Oct 19 00:30:51.127835 dv-cinder-master-3-smb devstack@n-api.service[110499]: machine: x86_64 Oct 19 00:30:51.127835 dv-cinder-master-3-smb devstack@n-api.service[110499]: clock source: unix Oct 19 00:30:51.127835 dv-cinder-master-3-smb devstack@n-api.service[110499]: pcre jit disabled Oct 19 00:30:51.127835 dv-cinder-master-3-smb devstack@n-api.service[110499]: detected number of CPU cores: 4 Oct 19 00:30:51.127835 dv-cinder-master-3-smb devstack@n-api.service[110499]: current working directory: / Oct 19 00:30:51.127835 dv-cinder-master-3-smb devstack@n-api.service[110499]: detected binary path: /usr/bin/uwsgi-core Oct 19 00:30:51.127835 dv-cinder-master-3-smb devstack@n-api.service[110499]: your processes number limit is 47680 Oct 19 00:30:51.127835 dv-cinder-master-3-smb devstack@n-api.service[110499]: your memory page size is 4096 bytes Oct 19 00:30:51.127835 dv-cinder-master-3-smb devstack@n-api.service[110499]: detected max file descriptor number: 2048 Oct 19 00:30:51.127835 dv-cinder-master-3-smb devstack@n-api.service[110499]: lock engine: pthread robust mutexes Oct 19 00:30:51.127835 dv-cinder-master-3-smb devstack@n-api.service[110499]: thunder lock: enabled Oct 19 00:30:51.127835 dv-cinder-master-3-smb devstack@n-api.service[110499]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 19 00:30:51.127835 dv-cinder-master-3-smb devstack@n-api.service[110499]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 19 00:30:51.166762 dv-cinder-master-3-smb devstack@n-api.service[110499]: Python main interpreter initialized at 0x5638f0c369c0 Oct 19 00:30:51.166762 dv-cinder-master-3-smb devstack@n-api.service[110499]: python threads support enabled Oct 19 00:30:51.166762 dv-cinder-master-3-smb devstack@n-api.service[110499]: your server socket listen backlog is limited to 100 connections Oct 19 00:30:51.166762 dv-cinder-master-3-smb devstack@n-api.service[110499]: your mercy for graceful operations on workers is 90 seconds Oct 19 00:30:51.167113 dv-cinder-master-3-smb devstack@n-api.service[110499]: mapped 403077 bytes (393 KB) for 2 cores Oct 19 00:30:51.167199 dv-cinder-master-3-smb devstack@n-api.service[110499]: *** Operational MODE: preforking *** Oct 19 00:30:51.167425 dv-cinder-master-3-smb devstack@n-api.service[110499]: *** uWSGI is running in multiple interpreter mode *** Oct 19 00:30:51.167425 dv-cinder-master-3-smb devstack@n-api.service[110499]: spawned uWSGI master process (pid: 110499) Oct 19 00:30:51.167612 dv-cinder-master-3-smb systemd[1]: Started Devstack devstack@n-api.service. Oct 19 00:30:51.168194 dv-cinder-master-3-smb devstack@n-api.service[110499]: spawned uWSGI worker 1 (pid: 110500, cores: 1) Oct 19 00:30:51.168538 dv-cinder-master-3-smb devstack@n-api.service[110499]: spawned uWSGI worker 2 (pid: 110501, cores: 1) Oct 19 00:30:51.168687 dv-cinder-master-3-smb devstack@n-api.service[110499]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 19 00:30:51.827257 dv-cinder-master-3-smb devstack@n-api.service[110501]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 19 00:30:51.827916 dv-cinder-master-3-smb devstack@n-api.service[110500]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 19 00:30:52.920500 dv-cinder-master-3-smb devstack@n-api.service[110501]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 00:30:52.920500 dv-cinder-master-3-smb devstack@n-api.service[110501]: from cryptography.utils import int_from_bytes Oct 19 00:30:52.921065 dv-cinder-master-3-smb devstack@n-api.service[110501]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 00:30:52.921065 dv-cinder-master-3-smb devstack@n-api.service[110501]: from cryptography.utils import int_from_bytes Oct 19 00:30:52.924860 dv-cinder-master-3-smb devstack@n-api.service[110500]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 00:30:52.924860 dv-cinder-master-3-smb devstack@n-api.service[110500]: from cryptography.utils import int_from_bytes Oct 19 00:30:52.925305 dv-cinder-master-3-smb devstack@n-api.service[110500]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 00:30:52.925305 dv-cinder-master-3-smb devstack@n-api.service[110500]: from cryptography.utils import int_from_bytes Oct 19 00:30:55.482100 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 00:30:55.482748 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 00:30:55.482894 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 00:30:55.483227 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 00:30:55.483483 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 00:30:55.483884 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.484212 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.484540 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.484858 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.485180 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.485489 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.485809 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.486129 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.486456 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.486715 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.487028 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.487359 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.487680 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.488030 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.488340 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.488654 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.488956 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.489274 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.489577 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.490071 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.490486 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.490826 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.491591 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.491837 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.492154 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.492461 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.492776 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.493089 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.493416 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.493731 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.494132 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.494447 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.494751 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.495062 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.495477 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.495786 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.496120 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.496442 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.496763 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.497071 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.497400 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.497718 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.498036 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.498354 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.498655 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.498989 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.499440 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.500064 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.500595 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.500912 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.501167 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.501478 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.501803 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.502128 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.502230 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 00:30:55.502629 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.502724 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 00:30:55.502806 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.502931 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.503021 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 00:30:55.503251 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.503340 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 00:30:55.503555 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 00:30:55.503725 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.503882 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.503983 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.504194 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.504332 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.504502 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.504721 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.504819 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.505103 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.505252 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.505408 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.505713 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.505809 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.506018 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.506863 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.507046 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.507393 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.507739 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.507908 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.508138 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.508315 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.508813 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.509227 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.509522 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.509679 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.509789 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.510012 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.510119 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.510354 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.510440 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.510677 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.510771 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.510985 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.511080 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.511296 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.511382 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.511611 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.511696 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.511939 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.512070 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.512251 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.512362 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.512559 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.512645 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.512880 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.513055 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.513476 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.513563 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.513778 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.514055 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.514144 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.514403 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.514501 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.514712 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.514982 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.515101 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.515302 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.515627 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.515712 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.515960 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.516247 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.516344 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.516679 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.516771 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.517089 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.517245 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.517500 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.517818 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.517903 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.518164 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.518359 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.518502 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.518780 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.518937 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.519090 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.519541 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.519647 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.519873 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.520190 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.520296 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.520566 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.520665 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.520937 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.521141 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.521250 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.521573 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.521658 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.521920 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.522739 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.522863 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.523238 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.523339 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.523553 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.523785 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.523901 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.524196 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.524376 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.524504 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.524812 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.524912 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.525134 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.525401 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.525489 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.525734 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.525933 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.526053 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.526359 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.526484 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.526665 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.526983 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.527120 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.527284 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.527480 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.527590 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.527912 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.528015 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.528229 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.528453 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.528548 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.528825 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.528990 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.529130 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.529542 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.529648 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.529869 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.529957 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.530134 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.530249 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.530395 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.530500 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.530716 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.530816 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.531042 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.531155 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.531356 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.531445 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.531671 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.531769 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.531995 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.532099 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.532301 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.532389 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.532609 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.532702 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.532914 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.533012 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.533219 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.533307 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.533522 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.533616 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.533836 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.533934 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.534214 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.534302 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.534547 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.534650 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.534866 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.535169 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.535258 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.535480 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.535717 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.535804 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.536128 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.536307 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.536438 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.536566 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.536748 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.536881 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.537069 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.537308 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.537404 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.537896 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.538195 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.538575 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.538899 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.539227 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.539545 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.539695 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.539879 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.540001 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.540213 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.540356 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.540529 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.540623 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.540841 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.540948 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.541155 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.541250 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.541480 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.541568 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.541815 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.541911 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.542121 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.542208 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.542372 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.542460 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.542676 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.542781 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.542981 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.543070 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.543297 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.543388 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.543609 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.543700 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.543934 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.544027 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.544239 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.544340 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.544615 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.544703 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.544927 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.545029 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.545243 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.545335 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.545547 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.545635 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.545849 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.545938 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.546151 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.546241 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.546453 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.546544 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.546760 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.546850 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.547096 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.547185 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.547404 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.547492 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.547704 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.547792 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.548046 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.548158 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.548356 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.548443 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.548654 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.548743 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.548958 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.549073 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.549256 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.549344 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.549557 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.549644 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.549857 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.549954 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.550157 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.550279 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.550459 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.550559 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.550763 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.550850 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.551062 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.551150 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.551360 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.551449 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.551672 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.551761 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.551996 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.552088 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.552297 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.552385 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.552609 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.552711 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.552909 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.553085 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.553762 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.553859 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.554086 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.554327 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.554564 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.554881 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.554970 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.555269 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.555358 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.555699 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.555896 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.556047 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.556353 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.556449 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.556657 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.556755 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.556959 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.557050 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.557261 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.557349 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.557559 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.557657 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.557858 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.557956 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.558176 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.558264 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.558481 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.558577 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.558813 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.558900 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.559131 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.559240 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.559443 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.559738 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:30:55.559948 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.560090 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.560344 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.560545 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.560723 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.560827 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.561057 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.561178 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.561363 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.561499 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.561812 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.561900 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.562152 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.562350 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.562737 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.563050 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.563439 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.563541 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.563808 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.563916 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.564168 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.564273 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.564505 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.564594 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.564827 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.564923 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.565136 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.565225 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.565445 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.565534 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.565753 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.565842 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.566062 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.566152 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.566370 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.566494 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.566692 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.566779 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.567008 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.567235 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.567444 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.567759 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.567972 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.568119 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.568372 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.568466 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.568843 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.569527 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.569711 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.569976 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.570111 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.570324 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.570699 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.570812 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.571153 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.571269 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.571473 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.571803 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.571945 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.572233 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.572339 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.572635 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.572807 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.572953 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.573270 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.573382 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.573778 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.573880 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.574128 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.574397 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.574484 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.574848 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.574946 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.575169 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.575426 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.575514 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.575800 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.575975 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.576155 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.576472 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.576559 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.576800 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.577036 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.577124 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.577414 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.577566 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.577757 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.578095 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.578189 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.578416 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.578622 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.578742 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.579056 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.579143 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.579375 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.579690 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.579799 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.580025 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.580253 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.580341 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.580641 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.580830 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.580962 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.581275 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.581363 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.581594 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.581826 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.581925 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.582217 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.582366 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.582530 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.582837 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.583020 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.583166 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.583321 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.583495 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.583644 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.583817 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.584006 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.584161 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.584340 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.584607 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.584812 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.584993 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.585297 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.585415 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.585602 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.585737 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.585914 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.586068 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.586228 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.586407 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.586535 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.586724 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.586844 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.587066 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.587168 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.587458 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.587547 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.587767 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.587928 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.588104 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.588302 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.588414 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.588728 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.588824 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.589039 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.589342 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.589431 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.589645 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.589811 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.589958 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.590134 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.590278 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.590453 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.590589 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.590787 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.591006 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.591229 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.591549 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.591875 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.592107 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.592335 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.592423 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.592651 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.592759 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.592957 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.593073 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.593261 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.593392 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.593571 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.593717 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.593914 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.594035 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.594224 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.594356 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.594527 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.594673 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.594844 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.594987 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.595166 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.595301 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.595476 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.595613 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.595789 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.596063 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.596205 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.596399 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.596626 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.596773 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.596907 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.597041 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.597190 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.597337 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.597475 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.597633 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.597773 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.597944 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.598090 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.598237 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.598370 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.598550 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.598698 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.598872 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.599017 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.599182 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.599274 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.599492 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.599585 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.599797 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.599930 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.600173 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.600397 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.600569 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.600890 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.600977 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.601280 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.601468 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.601588 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.601805 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.601894 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.602124 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.602222 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.602446 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.602542 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.602789 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.602876 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.603093 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.603192 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.603395 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.603486 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.603734 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.603823 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.604318 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.604410 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.604627 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.604716 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.604941 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.605029 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.605249 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.605375 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.605558 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.605656 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.605869 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.605957 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.606185 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.606279 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.606637 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.606774 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.606945 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.607226 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.607350 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.607554 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.607773 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.608008 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.608136 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.608432 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.608547 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.608747 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.609068 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.609189 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.609380 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.609505 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.609698 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.609821 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.610005 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.610119 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.610331 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.610454 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.610616 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.610739 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.610930 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.611046 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.611234 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.611354 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.611949 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.612079 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.612189 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.612300 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.612408 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.612531 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.612650 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.612823 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.613154 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.613268 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.613504 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.613740 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.613865 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.614065 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.614189 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.616149 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.616268 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.616346 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.616434 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.616507 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.616574 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.616640 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.617190 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.617190 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.617190 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.617190 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.617505 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.617944 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.618119 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.618361 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.618454 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.618680 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.618770 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.618991 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.619094 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.619306 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.619409 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.619618 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.619714 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.619958 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.620067 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.620273 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.620383 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.620581 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.620675 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.620889 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.620993 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.621291 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.621380 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.621719 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.621840 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.622045 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.622358 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.622445 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.622670 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.622914 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.623004 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.623275 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.623426 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.623671 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.623793 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.624130 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.624271 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.624443 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.624753 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.624847 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.625115 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.625257 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.625669 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.625805 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.625978 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.626253 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.626340 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.626691 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.626789 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.627013 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.627260 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.627348 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.627623 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.627821 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.628099 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.628228 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.628556 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.628680 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.628869 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.629187 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.629285 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.629511 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.629841 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.629930 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.630165 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.630480 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.630615 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.630799 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.630995 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.631108 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.632068 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.632220 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.632447 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.632643 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.632759 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.633070 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.633158 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.633381 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.633678 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.633768 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.633992 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.634204 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.634293 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.634613 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.634793 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.634924 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.635233 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.635320 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.635543 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.635837 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.635997 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.636205 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.636386 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.636525 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.636859 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.636997 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.637166 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.637461 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.637607 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.637811 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.637946 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.638281 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.638389 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.638597 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.638684 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.638915 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.639013 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.639223 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.639311 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.639540 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.639639 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.639898 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.640006 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.640194 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.640283 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.640503 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.640598 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.640813 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.640906 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.641137 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.641224 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.641449 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.641535 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.641761 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.641850 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.642075 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.642164 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.642383 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.642472 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.642709 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.642825 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.643018 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.643189 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.643329 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.643644 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.643977 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.644182 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.644294 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.644608 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.644794 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.644921 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.645207 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.645303 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.645536 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.645629 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.645849 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.645946 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.646161 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.646262 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.646469 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.646751 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.646894 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.647127 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.647519 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.647625 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.647841 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.648172 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.648440 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.648529 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.648780 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.648877 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.649088 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.649187 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.649402 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.649490 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.649709 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.649798 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.650068 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.650154 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.650389 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.650479 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.650711 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.650846 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.651028 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.651117 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.651338 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.651436 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.651651 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.651740 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.651989 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.652121 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.652300 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.652399 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.652617 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.652762 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.652921 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.653054 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.653232 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.653380 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.653533 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.653675 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.653847 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.653985 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.654173 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.654318 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.654485 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.654618 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.654793 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.654927 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.655102 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.655235 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.655408 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.655554 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.655701 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.655838 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.656032 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.656180 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.656346 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.656479 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.656653 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.656796 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.656976 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.657112 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.657338 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.657483 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.657650 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.657785 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.657975 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.658109 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.658281 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.658415 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.658585 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.658806 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.658947 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.659079 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.659211 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.659344 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.659488 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.659636 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.659770 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.659944 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.660097 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.660235 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.660408 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.660558 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.660717 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.660855 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.661024 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.661117 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.661325 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.661424 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.661632 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.661727 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.661933 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.662142 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.662250 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.662578 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.662747 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.662882 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.663327 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.663425 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.663645 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.663736 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.663979 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.664085 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.664286 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.664375 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.664596 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.664720 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.664902 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.665046 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.665218 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.665360 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.665522 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.665684 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.665826 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.666011 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.666144 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.666320 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.666410 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.666628 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.666772 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.666938 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.667078 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.667244 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.667405 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.667550 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.667713 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.667886 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.668045 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.668185 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.668499 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.668809 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.668896 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.669180 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.669267 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.669487 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.669680 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.670144 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.670474 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.670716 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.670864 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.671062 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.671328 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.671416 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.671650 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.671738 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.672005 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.672099 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.672336 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.672424 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.672648 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.672736 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.672962 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.673050 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.673274 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.673364 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.673578 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.673665 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.673884 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.673971 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.674190 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.674278 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.674495 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.674800 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.674889 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.675107 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.675414 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.675502 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.675727 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.676005 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.676097 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.676357 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.676458 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.676658 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.676746 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.676993 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.677080 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.677296 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.677546 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.677656 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.677962 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.678703 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.678864 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.679188 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.679578 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.679928 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.680338 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.680504 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.680659 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.680977 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.681094 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.681296 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.681505 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.681594 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.681828 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.681917 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.682142 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.682257 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.682456 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.682545 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.682771 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.682860 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.683088 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.683176 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.683404 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.683492 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.683714 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.683803 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.684047 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.684136 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.684366 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.684453 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.684672 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.684760 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.684999 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.685087 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.685301 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.685402 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.685612 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.685700 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.686071 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.686165 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.686420 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.686572 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.686706 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.686840 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.686996 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.687131 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.687309 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.687454 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.687609 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.687751 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.687930 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.688066 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.688239 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.688388 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.688532 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.688667 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.688838 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.688976 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.689146 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.689286 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.689438 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.689596 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.689741 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.689828 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.690056 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.690147 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.690414 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.690509 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.690731 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.690872 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.691048 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.691186 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.691367 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.691492 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.691959 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.692298 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.692400 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.692617 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.692706 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.693013 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.693122 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.693255 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.693579 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.693672 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.694517 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.694616 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.694836 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.694936 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.695155 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.695418 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.695506 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.695741 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.695832 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.696085 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.696183 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.696402 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.696491 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.696707 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.696795 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.697063 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.697151 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.697389 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.697478 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.697706 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.697804 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.698022 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.698109 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.698326 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.698418 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.698628 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.698730 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.698936 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.699025 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.699259 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.699348 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.699564 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.699657 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.699885 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.699978 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.700197 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.700285 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.700506 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.700594 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.700805 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.700894 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.701121 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.701218 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.701436 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.701528 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.701749 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.701840 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.702060 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.702149 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.702375 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.702514 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.702690 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.702823 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.703015 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.703162 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.703352 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.703454 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.703675 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.703768 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.704012 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.704119 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.704329 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.704418 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.704645 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.704733 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.704961 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.705173 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.705282 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.705495 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.705583 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.705833 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.705939 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.706162 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.706251 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.706478 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.706600 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.706793 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.706892 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.707108 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.707195 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.707416 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.707507 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.707732 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.707831 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.708067 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.708157 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.708383 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.708484 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.708696 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.708798 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.709004 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.709093 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.709328 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.709521 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.709687 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.709833 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.709961 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.710052 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.710282 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.710378 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.710593 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.710683 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.710898 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.711139 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.711445 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.711751 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.711874 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.712086 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.712365 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.712454 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.712687 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.712774 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.713094 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.713231 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.713408 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.713534 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.713719 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.713836 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.714017 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.714116 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.714338 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.714436 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.714642 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.714748 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.714959 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.715075 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.715269 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.715364 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.715572 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.715679 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.715909 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.716063 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.716232 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.716398 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.716546 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.716714 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.716868 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.717005 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.717146 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.717381 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.717707 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.717846 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.718013 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.718153 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.718405 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.718545 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.718918 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.719060 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.719360 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.719503 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.719667 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.719801 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.719998 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.720145 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.720311 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.720450 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.720620 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.720772 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.720938 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.721076 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.721247 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.721387 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.721600 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.721754 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.721890 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.722029 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.722178 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.722316 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.722485 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.722633 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.722795 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.722932 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.723094 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.723246 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.723390 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.723555 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.723689 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.723829 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.724030 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.724121 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.724351 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.724454 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.724650 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.724747 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.724951 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.725092 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.725297 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.725409 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.725596 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.725695 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.725915 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.726013 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.726220 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.726320 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.726519 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.726794 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.726893 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.727099 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.727196 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.727422 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.727517 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.727721 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.727808 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.728084 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.728187 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.728392 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.728574 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.728699 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.728797 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.729257 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.729352 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.729567 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.729653 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.729878 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.730025 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.730189 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.730277 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.730498 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.730594 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.730806 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.730892 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.731113 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.731200 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.731418 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.731513 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.731732 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.731844 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.732061 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.732206 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.732371 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.732461 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.732679 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.732988 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.733130 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.733310 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.733399 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.733614 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.733918 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.734241 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.734559 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.734905 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.735054 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.735226 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.735487 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.735642 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.735814 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.735921 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.736168 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.736258 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.736480 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.736569 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.736791 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.736904 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.737101 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.737191 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.737408 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.737496 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.737722 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.737810 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.738045 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.738132 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.738353 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.738510 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.738660 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.738750 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.738993 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.739306 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.739396 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.739668 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.739756 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.740014 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.740149 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.740339 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.740509 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.741151 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.741485 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.741810 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.741908 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.742125 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.742221 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.742446 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.742543 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.742759 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.742862 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.743088 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.743185 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.743433 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.743570 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.743736 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.743836 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.744078 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.744168 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.744383 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.744471 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.744690 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.744787 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.744994 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.745083 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.745302 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.745391 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.745616 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.745713 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.745923 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.746010 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.746227 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.746531 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.746725 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.746850 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.747051 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.747365 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.747453 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.747679 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.747918 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.748012 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.748459 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.748548 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.748834 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.748993 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.749166 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.749488 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.749583 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.749811 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.750060 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.750158 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.750424 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.750603 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.750747 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.751054 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.751141 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.751358 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.751682 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.752143 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.752649 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.752789 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.752978 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.753127 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.753295 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.753449 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.753609 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.753784 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.753922 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.754108 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.754228 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.754422 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.754539 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.754748 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.754877 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.755065 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.755217 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.755537 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.755661 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.755904 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.756033 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.756315 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.757068 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.757241 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.757568 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.757714 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.757890 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.758199 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.758335 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.758524 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.758739 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.758888 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.759128 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.759267 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.759536 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.759675 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.759869 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.760042 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.760180 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.760319 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.760486 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.760730 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.760869 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.761091 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.761330 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.761470 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.761689 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.761890 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.762082 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.762223 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.762413 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.762552 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.762721 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.762859 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.763027 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.763329 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.763462 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.763639 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.763963 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.764083 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.764321 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.764440 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.764631 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.764776 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.764933 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.765142 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.765242 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.765533 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.765741 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.765838 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.766131 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.766274 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.766438 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.766785 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.766873 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.767091 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.767352 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.767451 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.767700 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.767915 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.768018 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.768323 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.768462 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.768637 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.768944 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.769032 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.769263 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.769526 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.769625 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.769864 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.770072 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.770207 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.770506 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.770633 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.771048 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.771174 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.771379 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.771695 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.771783 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.772078 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.772315 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.772411 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.772702 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.772868 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.773001 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.773305 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.773451 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.773627 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.773934 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.774024 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.774244 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.774550 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.774638 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.774855 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.775114 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.775217 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.775453 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.775553 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.775755 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.775903 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.776095 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.776188 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.776401 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.776507 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.776706 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.776836 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.777009 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.777163 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.777313 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.777487 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.777619 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.777801 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.777923 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.778049 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 00:30:55.778231 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.778572 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.778888 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.779203 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.779513 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.779905 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.780379 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.780690 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.780999 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.781306 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.782160 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.782494 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.782815 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.783121 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.783874 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.784168 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.784492 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.784815 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.785127 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.785452 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.785776 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.786089 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.786408 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.786721 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.787048 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.787383 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.787733 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.788173 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.788483 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.788788 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.789091 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.789398 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.789712 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.790019 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.790320 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.790621 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.790927 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.791227 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.791527 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.791827 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.792150 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.792462 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.792762 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.793061 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.793359 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.793658 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.793956 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.794254 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.794557 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.794855 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.795153 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.795451 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.795748 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.796069 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.796396 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.796728 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.797039 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.797357 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.797663 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.798121 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.798285 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.798596 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.798913 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.799226 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.799531 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.800010 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.800324 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.800633 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.800943 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.801249 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.801555 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.801862 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.802193 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.802513 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.802834 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.803708 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.805733 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.806084 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.806419 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.806744 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.807195 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.807463 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.807791 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.808137 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.808454 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.808769 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.809088 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.809401 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.809714 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.810034 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.810351 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.810683 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.811010 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.811321 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.811650 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.812005 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.812361 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.812674 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.813018 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.813347 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.813662 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.813982 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.814285 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:30:55.814526 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 00:30:55.946823 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO dbcounter [None req-8e971caa-addd-4e3b-a79e-7c6a248c862c None None] Registered counter for database nova_api Oct 19 00:30:55.970033 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG oslo_db.sqlalchemy.engines [None req-8e971caa-addd-4e3b-a79e-7c6a248c862c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:30:55.978292 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG dbcounter [-] [110500] Writer thread running {{(pid=110500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:30:55.981865 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO dbcounter [None req-ca3baa72-0316-4780-90d8-914ccffafd2a None None] Registered counter for database nova_api Oct 19 00:30:56.003987 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG oslo_db.sqlalchemy.engines [None req-ca3baa72-0316-4780-90d8-914ccffafd2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:30:56.012558 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG dbcounter [-] [110501] Writer thread running {{(pid=110501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:30:56.040774 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.context [None req-8e971caa-addd-4e3b-a79e-7c6a248c862c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab(cell1) {{(pid=110500) load_cells /opt/stack/nova/nova/context.py:464}} Oct 19 00:30:56.044684 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG oslo_concurrency.lockutils [None req-8e971caa-addd-4e3b-a79e-7c6a248c862c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:30:56.045155 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG oslo_concurrency.lockutils [None req-8e971caa-addd-4e3b-a79e-7c6a248c862c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:30:56.047025 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG oslo_concurrency.lockutils [None req-8e971caa-addd-4e3b-a79e-7c6a248c862c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:30:56.048149 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG oslo_concurrency.lockutils [None req-8e971caa-addd-4e3b-a79e-7c6a248c862c None None] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:30:56.048596 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG oslo_concurrency.lockutils [None req-8e971caa-addd-4e3b-a79e-7c6a248c862c None None] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:30:56.050559 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG oslo_concurrency.lockutils [None req-8e971caa-addd-4e3b-a79e-7c6a248c862c None None] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:30:56.052604 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO dbcounter [None req-8e971caa-addd-4e3b-a79e-7c6a248c862c None None] Registered counter for database nova_cell0 Oct 19 00:30:56.058025 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO dbcounter [None req-8e971caa-addd-4e3b-a79e-7c6a248c862c None None] Registered counter for database nova_cell1 Oct 19 00:30:56.067141 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG oslo_db.sqlalchemy.engines [None req-8e971caa-addd-4e3b-a79e-7c6a248c862c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:30:56.068391 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG oslo_db.sqlalchemy.engines [None req-8e971caa-addd-4e3b-a79e-7c6a248c862c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:30:56.074192 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG dbcounter [-] [110500] Writer thread running {{(pid=110500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:30:56.074861 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.context [None req-ca3baa72-0316-4780-90d8-914ccffafd2a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab(cell1) {{(pid=110501) load_cells /opt/stack/nova/nova/context.py:464}} Oct 19 00:30:56.077517 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG dbcounter [-] [110500] Writer thread running {{(pid=110500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:30:56.080573 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG oslo_concurrency.lockutils [None req-ca3baa72-0316-4780-90d8-914ccffafd2a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:30:56.081047 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG oslo_concurrency.lockutils [None req-ca3baa72-0316-4780-90d8-914ccffafd2a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:30:56.082753 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG oslo_concurrency.lockutils [None req-ca3baa72-0316-4780-90d8-914ccffafd2a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:30:56.083494 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG oslo_concurrency.lockutils [None req-ca3baa72-0316-4780-90d8-914ccffafd2a None None] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:30:56.083957 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG oslo_concurrency.lockutils [None req-ca3baa72-0316-4780-90d8-914ccffafd2a None None] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:30:56.086383 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG oslo_concurrency.lockutils [None req-ca3baa72-0316-4780-90d8-914ccffafd2a None None] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:30:56.088553 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO dbcounter [None req-ca3baa72-0316-4780-90d8-914ccffafd2a None None] Registered counter for database nova_cell0 Oct 19 00:30:56.092593 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO dbcounter [None req-ca3baa72-0316-4780-90d8-914ccffafd2a None None] Registered counter for database nova_cell1 Oct 19 00:30:56.101407 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG oslo_db.sqlalchemy.engines [None req-ca3baa72-0316-4780-90d8-914ccffafd2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:30:56.102763 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG oslo_db.sqlalchemy.engines [None req-ca3baa72-0316-4780-90d8-914ccffafd2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:30:56.111650 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG dbcounter [-] [110501] Writer thread running {{(pid=110501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:30:56.112008 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG dbcounter [-] [110501] Writer thread running {{(pid=110501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:30:56.227685 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO dbcounter [None req-8e971caa-addd-4e3b-a79e-7c6a248c862c None None] Registered counter for database nova_cell0 Oct 19 00:30:56.236638 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG oslo_db.sqlalchemy.engines [None req-8e971caa-addd-4e3b-a79e-7c6a248c862c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:30:56.242046 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG dbcounter [-] [110500] Writer thread running {{(pid=110500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:30:56.259072 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO dbcounter [None req-ca3baa72-0316-4780-90d8-914ccffafd2a None None] Registered counter for database nova_cell0 Oct 19 00:30:56.267976 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG oslo_db.sqlalchemy.engines [None req-ca3baa72-0316-4780-90d8-914ccffafd2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:30:56.273956 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG dbcounter [-] [110501] Writer thread running {{(pid=110501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:30:56.580003 dv-cinder-master-3-smb devstack@n-api.service[110500]: WARNING keystonemiddleware.auth_token [None req-8e971caa-addd-4e3b-a79e-7c6a248c862c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 00:30:56.587824 dv-cinder-master-3-smb devstack@n-api.service[110500]: WARNING keystonemiddleware.auth_token [None req-8e971caa-addd-4e3b-a79e-7c6a248c862c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 00:30:56.598927 dv-cinder-master-3-smb devstack@n-api.service[110501]: WARNING keystonemiddleware.auth_token [None req-ca3baa72-0316-4780-90d8-914ccffafd2a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 00:30:56.607139 dv-cinder-master-3-smb devstack@n-api.service[110501]: WARNING keystonemiddleware.auth_token [None req-ca3baa72-0316-4780-90d8-914ccffafd2a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 00:30:56.929848 dv-cinder-master-3-smb devstack@n-api.service[110500]: WARNING keystonemiddleware.auth_token [None req-8e971caa-addd-4e3b-a79e-7c6a248c862c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 00:30:56.935688 dv-cinder-master-3-smb devstack@n-api.service[110500]: WARNING keystonemiddleware.auth_token [None req-8e971caa-addd-4e3b-a79e-7c6a248c862c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 00:30:56.941019 dv-cinder-master-3-smb devstack@n-api.service[110500]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5638f0c369c0 pid: 110500 (default app) Oct 19 00:30:56.943064 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-8e971caa-addd-4e3b-a79e-7c6a248c862c None None] Calling method '>' {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:30:56.944395 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-8e971caa-addd-4e3b-a79e-7c6a248c862c None None] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001848 Oct 19 00:30:56.944805 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 788 bytes} [Wed Oct 19 00:30:56 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:30:56.948236 dv-cinder-master-3-smb devstack@n-api.service[110501]: WARNING keystonemiddleware.auth_token [None req-ca3baa72-0316-4780-90d8-914ccffafd2a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 00:30:56.954139 dv-cinder-master-3-smb devstack@n-api.service[110501]: WARNING keystonemiddleware.auth_token [None req-ca3baa72-0316-4780-90d8-914ccffafd2a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 00:30:56.959309 dv-cinder-master-3-smb devstack@n-api.service[110501]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5638f0c369c0 pid: 110501 (default app) Oct 19 00:32:18.698196 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-8e971caa-addd-4e3b-a79e-7c6a248c862c None None] Calling method '>' {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:32:18.699942 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-8e971caa-addd-4e3b-a79e-7c6a248c862c None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002242 Oct 19 00:32:18.700563 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 2/2] 10.222.0.33 () {54 vars in 931 bytes} [Wed Oct 19 00:32:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:32:18.717012 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG dbcounter [-] [110501] Writing DB stats nova_api:SELECT=3 {{(pid=110501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:18.719310 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG dbcounter [-] [110501] Writing DB stats nova_cell0:SELECT=3 {{(pid=110501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:18.720346 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG dbcounter [-] [110501] Writing DB stats nova_cell1:SELECT=3 {{(pid=110501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:18.721551 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG dbcounter [-] [110501] Writing DB stats nova_cell0:SELECT=3 {{(pid=110501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:19.586404 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-ce531e7b-df56-47cd-9af1-0b2e78c4d667 admin admin] Calling method '>' {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:32:19.619894 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.requestlog [None req-ce531e7b-df56-47cd-9af1-0b2e78c4d667 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.912598 Oct 19 00:32:19.620767 dv-cinder-master-3-smb devstack@n-api.service[110501]: [pid: 110501|app: 0|req: 1/3] 10.222.0.33 () {60 vars in 1292 bytes} [Wed Oct 19 00:32:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:32:22.242688 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-8e971caa-addd-4e3b-a79e-7c6a248c862c None None] Calling method '>' {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:32:22.243821 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-8e971caa-addd-4e3b-a79e-7c6a248c862c None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Oct 19 00:32:22.244319 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 3/4] 10.222.0.33 () {54 vars in 931 bytes} [Wed Oct 19 00:32:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:32:22.700398 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-96132506-62c8-4015-bd98-327b29c9d6bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "disk": 1, "os-flavor-access:is_public": true}} {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:32:22.747780 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.requestlog [None req-96132506-62c8-4015-bd98-327b29c9d6bd admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.497043 Oct 19 00:32:22.748374 dv-cinder-master-3-smb devstack@n-api.service[110501]: [pid: 110501|app: 0|req: 2/5] 10.222.0.33 () {64 vars in 1283 bytes} [Wed Oct 19 00:32:22 2022] POST /compute/v2.1/flavors => generated 407 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:32:22.762194 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG dbcounter [-] [110500] Writing DB stats nova_api:SELECT=3 {{(pid=110500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:22.763146 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG dbcounter [-] [110500] Writing DB stats nova_cell0:SELECT=3 {{(pid=110500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:22.765099 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG dbcounter [-] [110500] Writing DB stats nova_cell1:SELECT=3 {{(pid=110500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:22.765872 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG dbcounter [-] [110500] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:22.974542 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-17be5d78-3cc8-49cc-adf1-8dcce8e246b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:32:23.055060 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-17be5d78-3cc8-49cc-adf1-8dcce8e246b4 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.298063 Oct 19 00:32:23.055818 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 4/6] 10.222.0.33 () {64 vars in 1336 bytes} [Wed Oct 19 00:32:22 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:32:25.651964 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-96132506-62c8-4015-bd98-327b29c9d6bd admin admin] Calling method '>' {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:32:25.652999 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.requestlog [None req-96132506-62c8-4015-bd98-327b29c9d6bd admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Oct 19 00:32:25.653405 dv-cinder-master-3-smb devstack@n-api.service[110501]: [pid: 110501|app: 0|req: 3/7] 10.222.0.33 () {54 vars in 931 bytes} [Wed Oct 19 00:32:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:32:26.317349 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-f2df4632-25fa-4cef-9604-b5ef991a75c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 5, "rxtx_factor": 1.0, "id": "d1", "swap": 0}} {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:32:26.360245 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-f2df4632-25fa-4cef-9604-b5ef991a75c5 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.700036 Oct 19 00:32:26.363959 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 5/8] 10.222.0.33 () {64 vars in 1283 bytes} [Wed Oct 19 00:32:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:32:26.374266 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-7257d4be-bab5-4177-835f-565dd5092364 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:32:26.415997 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.requestlog [None req-7257d4be-bab5-4177-835f-565dd5092364 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045599 Oct 19 00:32:26.416646 dv-cinder-master-3-smb devstack@n-api.service[110501]: [pid: 110501|app: 0|req: 4/9] 10.222.0.33 () {64 vars in 1336 bytes} [Wed Oct 19 00:32:26 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:32:29.025051 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-f2df4632-25fa-4cef-9604-b5ef991a75c5 admin admin] Calling method '>' {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:32:29.026063 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-f2df4632-25fa-4cef-9604-b5ef991a75c5 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 19 00:32:29.026484 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 6/10] 10.222.0.33 () {54 vars in 931 bytes} [Wed Oct 19 00:32:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:32:29.452335 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-3b7d0c79-76f2-4660-afab-3f1c6836aa2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "os-flavor-access:is_public": true, "disk": 10, "vcpus": 1, "ram": 1024, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0}} {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:32:29.472115 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.requestlog [None req-3b7d0c79-76f2-4660-afab-3f1c6836aa2c admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.439488 Oct 19 00:32:29.472702 dv-cinder-master-3-smb devstack@n-api.service[110501]: [pid: 110501|app: 0|req: 5/11] 10.222.0.33 () {64 vars in 1283 bytes} [Wed Oct 19 00:32:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:32:29.485372 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-4d795419-3d50-4f73-b3b4-2291b7167132 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:32:29.515956 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-4d795419-3d50-4f73-b3b4-2291b7167132 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034724 Oct 19 00:32:29.516718 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 7/12] 10.222.0.33 () {64 vars in 1336 bytes} [Wed Oct 19 00:32:29 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:32:32.184573 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-3b7d0c79-76f2-4660-afab-3f1c6836aa2c admin admin] Calling method '>' {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:32:32.185501 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.requestlog [None req-3b7d0c79-76f2-4660-afab-3f1c6836aa2c admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Oct 19 00:32:32.185904 dv-cinder-master-3-smb devstack@n-api.service[110501]: [pid: 110501|app: 0|req: 6/13] 10.222.0.33 () {54 vars in 931 bytes} [Wed Oct 19 00:32:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:32:32.599729 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-fb8a3c85-fe14-4361-b46c-80e8158cd789 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "d3", "vcpus": 2, "rxtx_factor": 1.0, "disk": 10, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:32:32.626929 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-fb8a3c85-fe14-4361-b46c-80e8158cd789 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.434983 Oct 19 00:32:32.627892 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 8/14] 10.222.0.33 () {64 vars in 1283 bytes} [Wed Oct 19 00:32:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:32:32.640071 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-232cfb8a-5adb-4157-8ef3-eb9f7ff52c20 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:32:32.670239 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.requestlog [None req-232cfb8a-5adb-4157-8ef3-eb9f7ff52c20 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033899 Oct 19 00:32:32.671259 dv-cinder-master-3-smb devstack@n-api.service[110501]: [pid: 110501|app: 0|req: 7/15] 10.222.0.33 () {64 vars in 1336 bytes} [Wed Oct 19 00:32:32 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:32:35.325057 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-fb8a3c85-fe14-4361-b46c-80e8158cd789 admin admin] Calling method '>' {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:32:35.326065 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-fb8a3c85-fe14-4361-b46c-80e8158cd789 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Oct 19 00:32:35.326486 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 9/16] 10.222.0.33 () {54 vars in 931 bytes} [Wed Oct 19 00:32:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:32:35.780786 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-dbf9a3eb-84f3-4e06-b983-614d00ac17c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d4", "swap": 0, "vcpus": 4, "disk": 20, "name": "ds4G"}} {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:32:35.800941 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.requestlog [None req-dbf9a3eb-84f3-4e06-b983-614d00ac17c8 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.468203 Oct 19 00:32:35.801551 dv-cinder-master-3-smb devstack@n-api.service[110501]: [pid: 110501|app: 0|req: 8/17] 10.222.0.33 () {64 vars in 1283 bytes} [Wed Oct 19 00:32:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 00:32:35.816062 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-f81b828c-ba38-4086-8999-c817e1679a09 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:32:35.842209 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-f81b828c-ba38-4086-8999-c817e1679a09 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030264 Oct 19 00:32:35.842788 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 10/18] 10.222.0.33 () {64 vars in 1336 bytes} [Wed Oct 19 00:32:35 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:32:38.780433 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-dbf9a3eb-84f3-4e06-b983-614d00ac17c8 admin admin] Calling method '>' {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:32:38.782739 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.requestlog [None req-dbf9a3eb-84f3-4e06-b983-614d00ac17c8 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003074 Oct 19 00:32:38.784022 dv-cinder-master-3-smb devstack@n-api.service[110501]: [pid: 110501|app: 0|req: 9/19] 10.222.0.33 () {54 vars in 931 bytes} [Wed Oct 19 00:32:38 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:32:39.224629 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-0e5af843-801f-4ff0-9640-acccd4b988f9 admin admin] Calling method '>' {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:32:39.249385 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-0e5af843-801f-4ff0-9640-acccd4b988f9 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.457917 Oct 19 00:32:39.249922 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 11/20] 10.222.0.33 () {60 vars in 1292 bytes} [Wed Oct 19 00:32:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:32:42.058774 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-dbf9a3eb-84f3-4e06-b983-614d00ac17c8 admin admin] Calling method '>' {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:32:42.059790 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.requestlog [None req-dbf9a3eb-84f3-4e06-b983-614d00ac17c8 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 19 00:32:42.060513 dv-cinder-master-3-smb devstack@n-api.service[110501]: [pid: 110501|app: 0|req: 10/21] 10.222.0.33 () {54 vars in 931 bytes} [Wed Oct 19 00:32:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:32:42.465887 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-f80bfbbd-6666-41b6-bcca-2ce0869183b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 512, "name": "m1.tiny", "rxtx_factor": 1.0, "disk": 1}} {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:32:42.485986 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-f80bfbbd-6666-41b6-bcca-2ce0869183b0 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.419810 Oct 19 00:32:42.486634 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 12/22] 10.222.0.33 () {64 vars in 1283 bytes} [Wed Oct 19 00:32:42 2022] POST /compute/v2.1/flavors => generated 402 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 00:32:42.498601 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-94360697-87d5-4855-b046-4653eccf80e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:32:42.526768 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.requestlog [None req-94360697-87d5-4855-b046-4653eccf80e6 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031772 Oct 19 00:32:42.527335 dv-cinder-master-3-smb devstack@n-api.service[110501]: [pid: 110501|app: 0|req: 11/23] 10.222.0.33 () {64 vars in 1333 bytes} [Wed Oct 19 00:32:42 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:32:45.152159 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-f80bfbbd-6666-41b6-bcca-2ce0869183b0 admin admin] Calling method '>' {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:32:45.153178 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-f80bfbbd-6666-41b6-bcca-2ce0869183b0 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Oct 19 00:32:45.153725 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 13/24] 10.222.0.33 () {54 vars in 931 bytes} [Wed Oct 19 00:32:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:32:45.538434 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-126a6ad4-a93a-43a1-93c6-93190067ff37 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "2", "name": "m1.small", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 2048, "rxtx_factor": 1.0}} {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:32:45.558366 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.requestlog [None req-126a6ad4-a93a-43a1-93c6-93190067ff37 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.398633 Oct 19 00:32:45.559241 dv-cinder-master-3-smb devstack@n-api.service[110501]: [pid: 110501|app: 0|req: 12/25] 10.222.0.33 () {64 vars in 1283 bytes} [Wed Oct 19 00:32:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:32:45.578668 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-bc4dc9ac-06a0-496f-aa61-972502d47b02 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:32:45.610778 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-bc4dc9ac-06a0-496f-aa61-972502d47b02 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042994 Oct 19 00:32:45.612643 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 14/26] 10.222.0.33 () {64 vars in 1333 bytes} [Wed Oct 19 00:32:45 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:32:48.349724 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-126a6ad4-a93a-43a1-93c6-93190067ff37 admin admin] Calling method '>' {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:32:48.351263 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.requestlog [None req-126a6ad4-a93a-43a1-93c6-93190067ff37 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001985 Oct 19 00:32:48.351660 dv-cinder-master-3-smb devstack@n-api.service[110501]: [pid: 110501|app: 0|req: 13/27] 10.222.0.33 () {54 vars in 931 bytes} [Wed Oct 19 00:32:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:32:48.811587 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-27b60f84-dafc-40f5-a40b-68e6f9022095 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "3", "name": "m1.medium", "vcpus": 2, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "swap": 0}} {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:32:48.834483 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-27b60f84-dafc-40f5-a40b-68e6f9022095 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.476318 Oct 19 00:32:48.835027 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 15/28] 10.222.0.33 () {64 vars in 1283 bytes} [Wed Oct 19 00:32:48 2022] POST /compute/v2.1/flavors => generated 406 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:32:48.847095 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-dd4bcabc-2829-4168-8e4e-af299880612c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:32:48.852453 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG dbcounter [-] [110501] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=110501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:48.883709 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.requestlog [None req-dd4bcabc-2829-4168-8e4e-af299880612c admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040259 Oct 19 00:32:48.884334 dv-cinder-master-3-smb devstack@n-api.service[110501]: [pid: 110501|app: 0|req: 14/29] 10.222.0.33 () {64 vars in 1333 bytes} [Wed Oct 19 00:32:48 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:32:51.576871 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-27b60f84-dafc-40f5-a40b-68e6f9022095 admin admin] Calling method '>' {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:32:51.576871 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-27b60f84-dafc-40f5-a40b-68e6f9022095 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.006436 Oct 19 00:32:51.576871 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 16/30] 10.222.0.33 () {54 vars in 931 bytes} [Wed Oct 19 00:32:51 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:32:52.039759 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-b6a4cfe4-b249-4572-82ea-8ae215c56601 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "vcpus": 4, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "os-flavor-access:is_public": true, "id": "4", "name": "m1.large"}} {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:32:52.059655 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.requestlog [None req-b6a4cfe4-b249-4572-82ea-8ae215c56601 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.471272 Oct 19 00:32:52.060492 dv-cinder-master-3-smb devstack@n-api.service[110501]: [pid: 110501|app: 0|req: 15/31] 10.222.0.33 () {64 vars in 1283 bytes} [Wed Oct 19 00:32:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:32:52.072868 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-6d89314a-31bc-46bc-9909-9e0c83a94fb6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:32:52.098000 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-6d89314a-31bc-46bc-9909-9e0c83a94fb6 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029328 Oct 19 00:32:52.098580 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 17/32] 10.222.0.33 () {64 vars in 1333 bytes} [Wed Oct 19 00:32:52 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:32:54.738972 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-b6a4cfe4-b249-4572-82ea-8ae215c56601 admin admin] Calling method '>' {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:32:54.740752 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.requestlog [None req-b6a4cfe4-b249-4572-82ea-8ae215c56601 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002156 Oct 19 00:32:54.741332 dv-cinder-master-3-smb devstack@n-api.service[110501]: [pid: 110501|app: 0|req: 16/33] 10.222.0.33 () {54 vars in 931 bytes} [Wed Oct 19 00:32:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:32:55.171768 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-2b5ad8df-7277-499c-8b46-24cf2136ce6c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "rxtx_factor": 1.0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 160, "id": "5", "swap": 0, "ram": 16384}} {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:32:55.179875 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG dbcounter [-] [110500] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=110500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:32:55.197190 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-2b5ad8df-7277-499c-8b46-24cf2136ce6c admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.449743 Oct 19 00:32:55.197734 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 18/34] 10.222.0.33 () {64 vars in 1283 bytes} [Wed Oct 19 00:32:54 2022] POST /compute/v2.1/flavors => generated 408 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:32:55.210521 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-20d7a5a5-27f9-41cd-be15-9371d6b78536 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:32:55.243212 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.requestlog [None req-20d7a5a5-27f9-41cd-be15-9371d6b78536 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035726 Oct 19 00:32:55.252302 dv-cinder-master-3-smb devstack@n-api.service[110501]: [pid: 110501|app: 0|req: 17/35] 10.222.0.33 () {64 vars in 1333 bytes} [Wed Oct 19 00:32:55 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:33:11.441408 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-2b5ad8df-7277-499c-8b46-24cf2136ce6c admin admin] Calling method '>' {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:33:11.442421 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-2b5ad8df-7277-499c-8b46-24cf2136ce6c admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Oct 19 00:33:11.442826 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 19/36] 10.222.0.33 () {54 vars in 931 bytes} [Wed Oct 19 00:33:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:33:11.453176 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG dbcounter [-] [110501] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=110501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:33:11.836286 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-a8af209e-fd8a-4ee3-9b5d-6401d06faee6 admin admin] Calling method '>' {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:33:11.854675 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.requestlog [None req-a8af209e-fd8a-4ee3-9b5d-6401d06faee6 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.405938 Oct 19 00:33:11.855215 dv-cinder-master-3-smb devstack@n-api.service[110501]: [pid: 110501|app: 0|req: 18/37] 10.222.0.33 () {60 vars in 1292 bytes} [Wed Oct 19 00:33:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:33:13.172241 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-2b5ad8df-7277-499c-8b46-24cf2136ce6c admin admin] Calling method '>' {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:33:13.173248 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-2b5ad8df-7277-499c-8b46-24cf2136ce6c admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Oct 19 00:33:13.173671 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 20/38] 10.222.0.33 () {56 vars in 1074 bytes} [Wed Oct 19 00:33:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:33:13.695462 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-ca56d6e6-614f-4249-a1e2-221f9bcf0222 admin admin] Calling method '>' {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:33:13.700781 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.wsgi [None req-ca56d6e6-614f-4249-a1e2-221f9bcf0222 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 19 00:33:13.703997 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-ca56d6e6-614f-4249-a1e2-221f9bcf0222 admin admin] Request method failure captured: Oct 19 00:33:13.703997 dv-cinder-master-3-smb devstack@n-api.service[110501]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 19 00:33:13.703997 dv-cinder-master-3-smb devstack@n-api.service[110501]: Accept: application/json Oct 19 00:33:13.703997 dv-cinder-master-3-smb devstack@n-api.service[110501]: Accept-Encoding: gzip, deflate Oct 19 00:33:13.703997 dv-cinder-master-3-smb devstack@n-api.service[110501]: Connection: keep-alive Oct 19 00:33:13.703997 dv-cinder-master-3-smb devstack@n-api.service[110501]: Content-Length: 0 Oct 19 00:33:13.703997 dv-cinder-master-3-smb devstack@n-api.service[110501]: Host: 10.222.0.33 Oct 19 00:33:13.703997 dv-cinder-master-3-smb devstack@n-api.service[110501]: Openstack-Api-Version: compute 2.92 Oct 19 00:33:13.703997 dv-cinder-master-3-smb devstack@n-api.service[110501]: Openstack-System-Scope: None Oct 19 00:33:13.703997 dv-cinder-master-3-smb devstack@n-api.service[110501]: User-Agent: python-novaclient Oct 19 00:33:13.703997 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Auth-Token: gAAAAABjT0XJFX6VXbgsGlVqkmxHeemE6rA6miu3MJAsNsCc1l7x6JkUT_EtUwNi4op-n7wCX_J-QVK9MY4E3gJcLrxR7gQyyDokL--_yeMXIZ382CZA34mefcr3_Z8ddAmnaqsj1pqezs4L7bVHlI5x8Nb51AKFusxXQO1Q9aRdjz1wt-1rs0k Oct 19 00:33:13.703997 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Domain-Id: None Oct 19 00:33:13.703997 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Domain-Name: None Oct 19 00:33:13.703997 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Identity-Status: Confirmed Oct 19 00:33:13.703997 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Is-Admin-Project: True Oct 19 00:33:13.703997 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 00:33:13.703997 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Project-Domain-Id: default Oct 19 00:33:13.703997 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Project-Domain-Name: Default Oct 19 00:33:13.703997 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Project-Id: 303c1157509f409d8afed7ca58b4e513 Oct 19 00:33:13.703997 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Project-Name: admin Oct 19 00:33:13.703997 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Role: admin,member,reader Oct 19 00:33:13.703997 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Roles: admin,member,reader Oct 19 00:33:13.705614 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_303c1157509f409d8afed7ca58b4e513"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/303c1157509f409d8afed7ca58b4e513"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/303c1157509f409d8afed7ca58b4e513"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/303c1157509f409d8afed7ca58b4e513"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:33:13.705614 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Tenant: admin Oct 19 00:33:13.705614 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Tenant-Id: 303c1157509f409d8afed7ca58b4e513 Oct 19 00:33:13.705614 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Tenant-Name: admin Oct 19 00:33:13.705614 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-User: admin Oct 19 00:33:13.705614 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-User-Domain-Id: default Oct 19 00:33:13.705614 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-User-Domain-Name: Default Oct 19 00:33:13.705614 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-User-Id: ce8ca093fadc4e9da3bc39e824be9781 Oct 19 00:33:13.705614 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-User-Name: admin Oct 19 00:33:13.705614 dv-cinder-master-3-smb devstack@n-api.service[110501]: method: > Oct 19 00:33:13.705614 dv-cinder-master-3-smb devstack@n-api.service[110501]: exception: Flavor 42 could not be found. Oct 19 00:33:13.705614 dv-cinder-master-3-smb devstack@n-api.service[110501]: action_args: {'id': '42'} Oct 19 00:33:13.705614 dv-cinder-master-3-smb devstack@n-api.service[110501]: {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:33:13.705614 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:33:13.706697 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 00:33:13.706697 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 00:33:13.706697 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 00:33:13.706697 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 00:33:13.706697 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 00:33:13.706697 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 00:33:13.706697 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 00:33:13.706697 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 00:33:13.706697 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 00:33:13.706697 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:33:13.706697 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 00:33:13.706697 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 00:33:13.706697 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 19 00:33:13.706697 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi Oct 19 00:33:13.706697 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:33:13.706697 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi Oct 19 00:33:13.706697 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:33:13.706697 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:33:13.706697 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:33:13.708140 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:33:13.708140 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:33:13.708140 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:33:13.708140 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:33:13.708140 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 00:33:13.708140 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:33:13.708140 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 19 00:33:13.708140 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi Oct 19 00:33:13.708140 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:33:13.708140 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi Oct 19 00:33:13.708140 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:33:13.708140 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:33:13.708140 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:33:13.708140 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:33:13.708140 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:33:13.708140 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 19 00:33:13.708140 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi Oct 19 00:33:13.708140 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-ca56d6e6-614f-4249-a1e2-221f9bcf0222 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:33:13.709423 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.requestlog [None req-ca56d6e6-614f-4249-a1e2-221f9bcf0222 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.393253 Oct 19 00:33:13.709423 dv-cinder-master-3-smb devstack@n-api.service[110501]: [pid: 110501|app: 0|req: 19/39] 10.222.0.33 () {60 vars in 1190 bytes} [Wed Oct 19 00:33:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 00:33:13.715842 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-81ba37b1-7a59-4701-ab07-69456655a995 admin admin] Calling method '>' {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:33:13.737595 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-81ba37b1-7a59-4701-ab07-69456655a995 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025702 Oct 19 00:33:13.738137 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 21/40] 10.222.0.33 () {60 vars in 1210 bytes} [Wed Oct 19 00:33:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:33:13.749313 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-6c412e50-8e3e-4a91-b3bf-2885783d51d7 admin admin] Calling method '>' {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:33:13.771286 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.requestlog [None req-6c412e50-8e3e-4a91-b3bf-2885783d51d7 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026410 Oct 19 00:33:13.772411 dv-cinder-master-3-smb devstack@n-api.service[110501]: [pid: 110501|app: 0|req: 20/41] 10.222.0.33 () {60 vars in 1210 bytes} [Wed Oct 19 00:33:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:33:13.781578 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-3bddeb0f-62e1-45fd-878b-a0178f4eba78 admin admin] Calling method '>' {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:33:13.786871 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.wsgi [None req-3bddeb0f-62e1-45fd-878b-a0178f4eba78 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 19 00:33:13.790947 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-3bddeb0f-62e1-45fd-878b-a0178f4eba78 admin admin] Request method failure captured: Oct 19 00:33:13.790947 dv-cinder-master-3-smb devstack@n-api.service[110500]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 19 00:33:13.790947 dv-cinder-master-3-smb devstack@n-api.service[110500]: Accept: application/json Oct 19 00:33:13.790947 dv-cinder-master-3-smb devstack@n-api.service[110500]: Accept-Encoding: gzip, deflate Oct 19 00:33:13.790947 dv-cinder-master-3-smb devstack@n-api.service[110500]: Connection: keep-alive Oct 19 00:33:13.790947 dv-cinder-master-3-smb devstack@n-api.service[110500]: Content-Length: 0 Oct 19 00:33:13.790947 dv-cinder-master-3-smb devstack@n-api.service[110500]: Host: 10.222.0.33 Oct 19 00:33:13.790947 dv-cinder-master-3-smb devstack@n-api.service[110500]: Openstack-Api-Version: compute 2.92 Oct 19 00:33:13.790947 dv-cinder-master-3-smb devstack@n-api.service[110500]: Openstack-System-Scope: None Oct 19 00:33:13.790947 dv-cinder-master-3-smb devstack@n-api.service[110500]: User-Agent: python-novaclient Oct 19 00:33:13.790947 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Auth-Token: gAAAAABjT0XJFX6VXbgsGlVqkmxHeemE6rA6miu3MJAsNsCc1l7x6JkUT_EtUwNi4op-n7wCX_J-QVK9MY4E3gJcLrxR7gQyyDokL--_yeMXIZ382CZA34mefcr3_Z8ddAmnaqsj1pqezs4L7bVHlI5x8Nb51AKFusxXQO1Q9aRdjz1wt-1rs0k Oct 19 00:33:13.790947 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Domain-Id: None Oct 19 00:33:13.790947 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Domain-Name: None Oct 19 00:33:13.790947 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Identity-Status: Confirmed Oct 19 00:33:13.790947 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Is-Admin-Project: True Oct 19 00:33:13.790947 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 00:33:13.790947 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Project-Domain-Id: default Oct 19 00:33:13.790947 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Project-Domain-Name: Default Oct 19 00:33:13.790947 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Project-Id: 303c1157509f409d8afed7ca58b4e513 Oct 19 00:33:13.790947 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Project-Name: admin Oct 19 00:33:13.790947 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Role: admin,member,reader Oct 19 00:33:13.790947 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Roles: admin,member,reader Oct 19 00:33:13.792607 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_303c1157509f409d8afed7ca58b4e513"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/303c1157509f409d8afed7ca58b4e513"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/303c1157509f409d8afed7ca58b4e513"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/303c1157509f409d8afed7ca58b4e513"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:33:13.792607 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Tenant: admin Oct 19 00:33:13.792607 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Tenant-Id: 303c1157509f409d8afed7ca58b4e513 Oct 19 00:33:13.792607 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Tenant-Name: admin Oct 19 00:33:13.792607 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-User: admin Oct 19 00:33:13.792607 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-User-Domain-Id: default Oct 19 00:33:13.792607 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-User-Domain-Name: Default Oct 19 00:33:13.792607 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-User-Id: ce8ca093fadc4e9da3bc39e824be9781 Oct 19 00:33:13.792607 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-User-Name: admin Oct 19 00:33:13.792607 dv-cinder-master-3-smb devstack@n-api.service[110500]: method: > Oct 19 00:33:13.792607 dv-cinder-master-3-smb devstack@n-api.service[110500]: exception: Flavor 42 could not be found. Oct 19 00:33:13.792607 dv-cinder-master-3-smb devstack@n-api.service[110500]: action_args: {'id': '42'} Oct 19 00:33:13.792607 dv-cinder-master-3-smb devstack@n-api.service[110500]: {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:33:13.792607 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:33:13.793523 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 00:33:13.793523 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 00:33:13.793523 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 00:33:13.793523 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 00:33:13.793523 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 00:33:13.793523 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 00:33:13.793523 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 00:33:13.793523 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 00:33:13.793523 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 00:33:13.793523 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:33:13.793523 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 00:33:13.793523 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 00:33:13.793523 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 19 00:33:13.793523 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi Oct 19 00:33:13.793523 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:33:13.793523 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi Oct 19 00:33:13.793523 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:33:13.793523 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:33:13.793523 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:33:13.794666 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:33:13.794666 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:33:13.794666 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:33:13.794666 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:33:13.794666 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 00:33:13.794666 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:33:13.794666 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 19 00:33:13.794666 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi Oct 19 00:33:13.794666 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:33:13.794666 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi Oct 19 00:33:13.794666 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:33:13.794666 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:33:13.794666 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:33:13.794666 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:33:13.794666 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:33:13.794666 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 19 00:33:13.794666 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi Oct 19 00:33:13.794666 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-3bddeb0f-62e1-45fd-878b-a0178f4eba78 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:33:13.795648 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-3bddeb0f-62e1-45fd-878b-a0178f4eba78 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014314 Oct 19 00:33:13.795648 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 22/42] 10.222.0.33 () {60 vars in 1190 bytes} [Wed Oct 19 00:33:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 00:33:15.001018 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-6c412e50-8e3e-4a91-b3bf-2885783d51d7 admin admin] Calling method '>' {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:33:15.002024 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.requestlog [None req-6c412e50-8e3e-4a91-b3bf-2885783d51d7 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Oct 19 00:33:15.002417 dv-cinder-master-3-smb devstack@n-api.service[110501]: [pid: 110501|app: 0|req: 21/43] 10.222.0.33 () {56 vars in 1074 bytes} [Wed Oct 19 00:33:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:33:15.525299 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-ef678735-36fe-4e4c-a32a-3d498c82c3b9 admin admin] Calling method '>' {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:33:15.530321 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.wsgi [None req-ef678735-36fe-4e4c-a32a-3d498c82c3b9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 19 00:33:15.531815 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-ef678735-36fe-4e4c-a32a-3d498c82c3b9 admin admin] Request method failure captured: Oct 19 00:33:15.531815 dv-cinder-master-3-smb devstack@n-api.service[110500]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 19 00:33:15.531815 dv-cinder-master-3-smb devstack@n-api.service[110500]: Accept: application/json Oct 19 00:33:15.531815 dv-cinder-master-3-smb devstack@n-api.service[110500]: Accept-Encoding: gzip, deflate Oct 19 00:33:15.531815 dv-cinder-master-3-smb devstack@n-api.service[110500]: Connection: keep-alive Oct 19 00:33:15.531815 dv-cinder-master-3-smb devstack@n-api.service[110500]: Content-Length: 0 Oct 19 00:33:15.531815 dv-cinder-master-3-smb devstack@n-api.service[110500]: Host: 10.222.0.33 Oct 19 00:33:15.531815 dv-cinder-master-3-smb devstack@n-api.service[110500]: Openstack-Api-Version: compute 2.92 Oct 19 00:33:15.531815 dv-cinder-master-3-smb devstack@n-api.service[110500]: Openstack-System-Scope: None Oct 19 00:33:15.531815 dv-cinder-master-3-smb devstack@n-api.service[110500]: User-Agent: python-novaclient Oct 19 00:33:15.531815 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Auth-Token: gAAAAABjT0XK1d-gxrseZxrkblrtRF6IYCetq7Pk4wXLjq9wb6fl5tfajUjYDtlKbtJFu4qCXrpGz4BfV0I_7vJBYa7jZAMZGiFTY4JX6DXQYzwX3cJzvSAxauJ7DNxuRFf8EOxJ8_28xnUYVg-BkscDmaBvYU-5hJdUju8gXluE6S49ejxJCR8 Oct 19 00:33:15.531815 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Domain-Id: None Oct 19 00:33:15.531815 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Domain-Name: None Oct 19 00:33:15.531815 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Identity-Status: Confirmed Oct 19 00:33:15.531815 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Is-Admin-Project: True Oct 19 00:33:15.531815 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 00:33:15.531815 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Project-Domain-Id: default Oct 19 00:33:15.531815 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Project-Domain-Name: Default Oct 19 00:33:15.531815 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Project-Id: 303c1157509f409d8afed7ca58b4e513 Oct 19 00:33:15.531815 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Project-Name: admin Oct 19 00:33:15.531815 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Role: admin,member,reader Oct 19 00:33:15.531815 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Roles: admin,member,reader Oct 19 00:33:15.533442 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_303c1157509f409d8afed7ca58b4e513"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/303c1157509f409d8afed7ca58b4e513"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/303c1157509f409d8afed7ca58b4e513"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/303c1157509f409d8afed7ca58b4e513"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:33:15.533442 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Tenant: admin Oct 19 00:33:15.533442 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Tenant-Id: 303c1157509f409d8afed7ca58b4e513 Oct 19 00:33:15.533442 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Tenant-Name: admin Oct 19 00:33:15.533442 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-User: admin Oct 19 00:33:15.533442 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-User-Domain-Id: default Oct 19 00:33:15.533442 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-User-Domain-Name: Default Oct 19 00:33:15.533442 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-User-Id: ce8ca093fadc4e9da3bc39e824be9781 Oct 19 00:33:15.533442 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-User-Name: admin Oct 19 00:33:15.533442 dv-cinder-master-3-smb devstack@n-api.service[110500]: method: > Oct 19 00:33:15.533442 dv-cinder-master-3-smb devstack@n-api.service[110500]: exception: Flavor 84 could not be found. Oct 19 00:33:15.533442 dv-cinder-master-3-smb devstack@n-api.service[110500]: action_args: {'id': '84'} Oct 19 00:33:15.533442 dv-cinder-master-3-smb devstack@n-api.service[110500]: {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:33:15.533442 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:33:15.534367 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 00:33:15.534367 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 00:33:15.534367 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 00:33:15.534367 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 00:33:15.534367 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 00:33:15.534367 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 00:33:15.534367 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 00:33:15.534367 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 00:33:15.534367 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 00:33:15.534367 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:33:15.534367 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 00:33:15.534367 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 00:33:15.534367 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 19 00:33:15.534367 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi Oct 19 00:33:15.534367 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:33:15.534367 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi Oct 19 00:33:15.534367 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:33:15.534367 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:33:15.534367 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:33:15.535647 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:33:15.535647 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:33:15.535647 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:33:15.535647 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:33:15.535647 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 00:33:15.535647 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:33:15.535647 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 19 00:33:15.535647 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi Oct 19 00:33:15.535647 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:33:15.535647 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi Oct 19 00:33:15.535647 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:33:15.535647 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:33:15.535647 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:33:15.535647 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:33:15.535647 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:33:15.535647 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 19 00:33:15.535647 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi Oct 19 00:33:15.535647 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-ef678735-36fe-4e4c-a32a-3d498c82c3b9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:33:15.536911 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-ef678735-36fe-4e4c-a32a-3d498c82c3b9 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.394529 Oct 19 00:33:15.536911 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 23/44] 10.222.0.33 () {60 vars in 1190 bytes} [Wed Oct 19 00:33:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 00:33:15.543110 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-48b72f2c-b69a-4370-bfe3-2ddeed37b87b admin admin] Calling method '>' {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:33:15.557846 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.requestlog [None req-48b72f2c-b69a-4370-bfe3-2ddeed37b87b admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018295 Oct 19 00:33:15.558376 dv-cinder-master-3-smb devstack@n-api.service[110501]: [pid: 110501|app: 0|req: 22/45] 10.222.0.33 () {60 vars in 1210 bytes} [Wed Oct 19 00:33:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:33:15.567687 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-bc809386-404e-43e4-a4a4-62c511a58f15 admin admin] Calling method '>' {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:33:15.586359 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-bc809386-404e-43e4-a4a4-62c511a58f15 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.022205 Oct 19 00:33:15.586912 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 24/46] 10.222.0.33 () {60 vars in 1210 bytes} [Wed Oct 19 00:33:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:33:15.598235 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-bd4a1c44-dcde-4163-b335-c2a3734c2825 admin admin] Calling method '>' {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:33:15.603551 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.wsgi [None req-bd4a1c44-dcde-4163-b335-c2a3734c2825 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 19 00:33:15.605637 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-bd4a1c44-dcde-4163-b335-c2a3734c2825 admin admin] Request method failure captured: Oct 19 00:33:15.605637 dv-cinder-master-3-smb devstack@n-api.service[110501]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 19 00:33:15.605637 dv-cinder-master-3-smb devstack@n-api.service[110501]: Accept: application/json Oct 19 00:33:15.605637 dv-cinder-master-3-smb devstack@n-api.service[110501]: Accept-Encoding: gzip, deflate Oct 19 00:33:15.605637 dv-cinder-master-3-smb devstack@n-api.service[110501]: Connection: keep-alive Oct 19 00:33:15.605637 dv-cinder-master-3-smb devstack@n-api.service[110501]: Content-Length: 0 Oct 19 00:33:15.605637 dv-cinder-master-3-smb devstack@n-api.service[110501]: Host: 10.222.0.33 Oct 19 00:33:15.605637 dv-cinder-master-3-smb devstack@n-api.service[110501]: Openstack-Api-Version: compute 2.92 Oct 19 00:33:15.605637 dv-cinder-master-3-smb devstack@n-api.service[110501]: Openstack-System-Scope: None Oct 19 00:33:15.605637 dv-cinder-master-3-smb devstack@n-api.service[110501]: User-Agent: python-novaclient Oct 19 00:33:15.605637 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Auth-Token: gAAAAABjT0XK1d-gxrseZxrkblrtRF6IYCetq7Pk4wXLjq9wb6fl5tfajUjYDtlKbtJFu4qCXrpGz4BfV0I_7vJBYa7jZAMZGiFTY4JX6DXQYzwX3cJzvSAxauJ7DNxuRFf8EOxJ8_28xnUYVg-BkscDmaBvYU-5hJdUju8gXluE6S49ejxJCR8 Oct 19 00:33:15.605637 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Domain-Id: None Oct 19 00:33:15.605637 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Domain-Name: None Oct 19 00:33:15.605637 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Identity-Status: Confirmed Oct 19 00:33:15.605637 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Is-Admin-Project: True Oct 19 00:33:15.605637 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 00:33:15.605637 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Project-Domain-Id: default Oct 19 00:33:15.605637 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Project-Domain-Name: Default Oct 19 00:33:15.605637 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Project-Id: 303c1157509f409d8afed7ca58b4e513 Oct 19 00:33:15.605637 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Project-Name: admin Oct 19 00:33:15.605637 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Role: admin,member,reader Oct 19 00:33:15.605637 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Roles: admin,member,reader Oct 19 00:33:15.607293 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_303c1157509f409d8afed7ca58b4e513"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/303c1157509f409d8afed7ca58b4e513"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/303c1157509f409d8afed7ca58b4e513"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/303c1157509f409d8afed7ca58b4e513"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:33:15.607293 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Tenant: admin Oct 19 00:33:15.607293 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Tenant-Id: 303c1157509f409d8afed7ca58b4e513 Oct 19 00:33:15.607293 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Tenant-Name: admin Oct 19 00:33:15.607293 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-User: admin Oct 19 00:33:15.607293 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-User-Domain-Id: default Oct 19 00:33:15.607293 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-User-Domain-Name: Default Oct 19 00:33:15.607293 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-User-Id: ce8ca093fadc4e9da3bc39e824be9781 Oct 19 00:33:15.607293 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-User-Name: admin Oct 19 00:33:15.607293 dv-cinder-master-3-smb devstack@n-api.service[110501]: method: > Oct 19 00:33:15.607293 dv-cinder-master-3-smb devstack@n-api.service[110501]: exception: Flavor 84 could not be found. Oct 19 00:33:15.607293 dv-cinder-master-3-smb devstack@n-api.service[110501]: action_args: {'id': '84'} Oct 19 00:33:15.607293 dv-cinder-master-3-smb devstack@n-api.service[110501]: {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:33:15.607293 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:33:15.608364 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 00:33:15.608364 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 00:33:15.608364 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 00:33:15.608364 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 00:33:15.608364 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 00:33:15.608364 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 00:33:15.608364 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 00:33:15.608364 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 00:33:15.608364 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 00:33:15.608364 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:33:15.608364 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 00:33:15.608364 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 00:33:15.608364 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 19 00:33:15.608364 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi Oct 19 00:33:15.608364 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:33:15.608364 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi Oct 19 00:33:15.608364 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:33:15.608364 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:33:15.608364 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:33:15.609717 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:33:15.609717 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:33:15.609717 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:33:15.609717 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:33:15.609717 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 00:33:15.609717 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:33:15.609717 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 19 00:33:15.609717 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi Oct 19 00:33:15.609717 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:33:15.609717 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi Oct 19 00:33:15.609717 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:33:15.609717 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:33:15.609717 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:33:15.609717 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:33:15.609717 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:33:15.609717 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 19 00:33:15.609717 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi Oct 19 00:33:15.609717 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-bd4a1c44-dcde-4163-b335-c2a3734c2825 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:33:15.610929 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.requestlog [None req-bd4a1c44-dcde-4163-b335-c2a3734c2825 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.013785 Oct 19 00:33:15.610929 dv-cinder-master-3-smb devstack@n-api.service[110501]: [pid: 110501|app: 0|req: 23/47] 10.222.0.33 () {60 vars in 1190 bytes} [Wed Oct 19 00:33:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 00:33:16.826558 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-bc809386-404e-43e4-a4a4-62c511a58f15 admin admin] Calling method '>' {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:33:16.827561 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-bc809386-404e-43e4-a4a4-62c511a58f15 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Oct 19 00:33:16.827971 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 25/48] 10.222.0.33 () {56 vars in 1074 bytes} [Wed Oct 19 00:33:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:33:17.357825 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-5eabf535-1385-4b58-b26c-9e6588b1e91e admin admin] Calling method '>' {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:33:17.363811 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.wsgi [None req-5eabf535-1385-4b58-b26c-9e6588b1e91e admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 19 00:33:17.365330 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-5eabf535-1385-4b58-b26c-9e6588b1e91e admin admin] Request method failure captured: Oct 19 00:33:17.365330 dv-cinder-master-3-smb devstack@n-api.service[110501]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 19 00:33:17.365330 dv-cinder-master-3-smb devstack@n-api.service[110501]: Accept: application/json Oct 19 00:33:17.365330 dv-cinder-master-3-smb devstack@n-api.service[110501]: Accept-Encoding: gzip, deflate Oct 19 00:33:17.365330 dv-cinder-master-3-smb devstack@n-api.service[110501]: Connection: keep-alive Oct 19 00:33:17.365330 dv-cinder-master-3-smb devstack@n-api.service[110501]: Content-Length: 0 Oct 19 00:33:17.365330 dv-cinder-master-3-smb devstack@n-api.service[110501]: Host: 10.222.0.33 Oct 19 00:33:17.365330 dv-cinder-master-3-smb devstack@n-api.service[110501]: Openstack-Api-Version: compute 2.92 Oct 19 00:33:17.365330 dv-cinder-master-3-smb devstack@n-api.service[110501]: Openstack-System-Scope: None Oct 19 00:33:17.365330 dv-cinder-master-3-smb devstack@n-api.service[110501]: User-Agent: python-novaclient Oct 19 00:33:17.365330 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Auth-Token: gAAAAABjT0XMJhXZtQaRGwjravy5VBTP9Sb3BtX3xnIE2B2kVRKwW-IIIhjZzCByFz9CXV90ydbasqAtr_4M-HFHkQCDn9nwoqK2CxyKnZxPR65kne2LyHhE5vhJfqyWGUuKku6JV8SHZaITrwCL6Ponv4UzY5GfjetCfjSB83V279vTzrnIe8g Oct 19 00:33:17.365330 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Domain-Id: None Oct 19 00:33:17.365330 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Domain-Name: None Oct 19 00:33:17.365330 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Identity-Status: Confirmed Oct 19 00:33:17.365330 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Is-Admin-Project: True Oct 19 00:33:17.365330 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 00:33:17.365330 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Project-Domain-Id: default Oct 19 00:33:17.365330 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Project-Domain-Name: Default Oct 19 00:33:17.365330 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Project-Id: 303c1157509f409d8afed7ca58b4e513 Oct 19 00:33:17.365330 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Project-Name: admin Oct 19 00:33:17.365330 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Role: admin,member,reader Oct 19 00:33:17.365330 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Roles: admin,member,reader Oct 19 00:33:17.366853 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_303c1157509f409d8afed7ca58b4e513"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/303c1157509f409d8afed7ca58b4e513"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/303c1157509f409d8afed7ca58b4e513"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/303c1157509f409d8afed7ca58b4e513"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:33:17.366853 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Tenant: admin Oct 19 00:33:17.366853 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Tenant-Id: 303c1157509f409d8afed7ca58b4e513 Oct 19 00:33:17.366853 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-Tenant-Name: admin Oct 19 00:33:17.366853 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-User: admin Oct 19 00:33:17.366853 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-User-Domain-Id: default Oct 19 00:33:17.366853 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-User-Domain-Name: Default Oct 19 00:33:17.366853 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-User-Id: ce8ca093fadc4e9da3bc39e824be9781 Oct 19 00:33:17.366853 dv-cinder-master-3-smb devstack@n-api.service[110501]: X-User-Name: admin Oct 19 00:33:17.366853 dv-cinder-master-3-smb devstack@n-api.service[110501]: method: > Oct 19 00:33:17.366853 dv-cinder-master-3-smb devstack@n-api.service[110501]: exception: Flavor 451 could not be found. Oct 19 00:33:17.366853 dv-cinder-master-3-smb devstack@n-api.service[110501]: action_args: {'id': '451'} Oct 19 00:33:17.366853 dv-cinder-master-3-smb devstack@n-api.service[110501]: {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:33:17.366853 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:33:17.368517 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 00:33:17.368517 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 00:33:17.368517 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 00:33:17.368517 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 00:33:17.368517 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 00:33:17.368517 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 00:33:17.368517 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 00:33:17.368517 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 00:33:17.368517 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 00:33:17.368517 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:33:17.368517 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 00:33:17.368517 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 00:33:17.368517 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 19 00:33:17.368517 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi Oct 19 00:33:17.368517 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:33:17.368517 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi Oct 19 00:33:17.368517 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:33:17.368517 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:33:17.368517 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:33:17.369960 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:33:17.369960 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:33:17.369960 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:33:17.369960 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:33:17.369960 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 00:33:17.369960 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:33:17.369960 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 19 00:33:17.369960 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi Oct 19 00:33:17.369960 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:33:17.369960 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi Oct 19 00:33:17.369960 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:33:17.369960 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:33:17.369960 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:33:17.369960 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:33:17.369960 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:33:17.369960 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 19 00:33:17.369960 dv-cinder-master-3-smb devstack@n-api.service[110501]: ERROR nova.api.openstack.wsgi Oct 19 00:33:17.369960 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-5eabf535-1385-4b58-b26c-9e6588b1e91e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:33:17.371334 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.requestlog [None req-5eabf535-1385-4b58-b26c-9e6588b1e91e admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.400591 Oct 19 00:33:17.371334 dv-cinder-master-3-smb devstack@n-api.service[110501]: [pid: 110501|app: 0|req: 24/49] 10.222.0.33 () {60 vars in 1193 bytes} [Wed Oct 19 00:33:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 19 00:33:17.377161 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-dab4fdec-731b-4d04-966d-e3dc9f535933 admin admin] Calling method '>' {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:33:17.392592 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-dab4fdec-731b-4d04-966d-e3dc9f535933 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019027 Oct 19 00:33:17.393113 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 26/50] 10.222.0.33 () {60 vars in 1210 bytes} [Wed Oct 19 00:33:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:33:17.402244 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-4c303d56-62a4-4b9c-a3ed-0cdd1490e3d2 admin admin] Calling method '>' {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:33:17.417204 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.requestlog [None req-4c303d56-62a4-4b9c-a3ed-0cdd1490e3d2 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018492 Oct 19 00:33:17.417733 dv-cinder-master-3-smb devstack@n-api.service[110501]: [pid: 110501|app: 0|req: 25/51] 10.222.0.33 () {60 vars in 1210 bytes} [Wed Oct 19 00:33:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:33:17.426890 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-74cb4945-8183-4917-a56f-630cc4be671b admin admin] Calling method '>' {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:33:17.432786 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.wsgi [None req-74cb4945-8183-4917-a56f-630cc4be671b admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 19 00:33:17.434636 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-74cb4945-8183-4917-a56f-630cc4be671b admin admin] Request method failure captured: Oct 19 00:33:17.434636 dv-cinder-master-3-smb devstack@n-api.service[110500]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 19 00:33:17.434636 dv-cinder-master-3-smb devstack@n-api.service[110500]: Accept: application/json Oct 19 00:33:17.434636 dv-cinder-master-3-smb devstack@n-api.service[110500]: Accept-Encoding: gzip, deflate Oct 19 00:33:17.434636 dv-cinder-master-3-smb devstack@n-api.service[110500]: Connection: keep-alive Oct 19 00:33:17.434636 dv-cinder-master-3-smb devstack@n-api.service[110500]: Content-Length: 0 Oct 19 00:33:17.434636 dv-cinder-master-3-smb devstack@n-api.service[110500]: Host: 10.222.0.33 Oct 19 00:33:17.434636 dv-cinder-master-3-smb devstack@n-api.service[110500]: Openstack-Api-Version: compute 2.92 Oct 19 00:33:17.434636 dv-cinder-master-3-smb devstack@n-api.service[110500]: Openstack-System-Scope: None Oct 19 00:33:17.434636 dv-cinder-master-3-smb devstack@n-api.service[110500]: User-Agent: python-novaclient Oct 19 00:33:17.434636 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Auth-Token: gAAAAABjT0XMJhXZtQaRGwjravy5VBTP9Sb3BtX3xnIE2B2kVRKwW-IIIhjZzCByFz9CXV90ydbasqAtr_4M-HFHkQCDn9nwoqK2CxyKnZxPR65kne2LyHhE5vhJfqyWGUuKku6JV8SHZaITrwCL6Ponv4UzY5GfjetCfjSB83V279vTzrnIe8g Oct 19 00:33:17.434636 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Domain-Id: None Oct 19 00:33:17.434636 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Domain-Name: None Oct 19 00:33:17.434636 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Identity-Status: Confirmed Oct 19 00:33:17.434636 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Is-Admin-Project: True Oct 19 00:33:17.434636 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 00:33:17.434636 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Project-Domain-Id: default Oct 19 00:33:17.434636 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Project-Domain-Name: Default Oct 19 00:33:17.434636 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Project-Id: 303c1157509f409d8afed7ca58b4e513 Oct 19 00:33:17.434636 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Project-Name: admin Oct 19 00:33:17.434636 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Role: admin,member,reader Oct 19 00:33:17.434636 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Roles: admin,member,reader Oct 19 00:33:17.436163 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_303c1157509f409d8afed7ca58b4e513"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/303c1157509f409d8afed7ca58b4e513"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/303c1157509f409d8afed7ca58b4e513"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/303c1157509f409d8afed7ca58b4e513"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:33:17.436163 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Tenant: admin Oct 19 00:33:17.436163 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Tenant-Id: 303c1157509f409d8afed7ca58b4e513 Oct 19 00:33:17.436163 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-Tenant-Name: admin Oct 19 00:33:17.436163 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-User: admin Oct 19 00:33:17.436163 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-User-Domain-Id: default Oct 19 00:33:17.436163 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-User-Domain-Name: Default Oct 19 00:33:17.436163 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-User-Id: ce8ca093fadc4e9da3bc39e824be9781 Oct 19 00:33:17.436163 dv-cinder-master-3-smb devstack@n-api.service[110500]: X-User-Name: admin Oct 19 00:33:17.436163 dv-cinder-master-3-smb devstack@n-api.service[110500]: method: > Oct 19 00:33:17.436163 dv-cinder-master-3-smb devstack@n-api.service[110500]: exception: Flavor 451 could not be found. Oct 19 00:33:17.436163 dv-cinder-master-3-smb devstack@n-api.service[110500]: action_args: {'id': '451'} Oct 19 00:33:17.436163 dv-cinder-master-3-smb devstack@n-api.service[110500]: {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:33:17.436163 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:33:17.437004 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 00:33:17.437004 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 00:33:17.437004 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 00:33:17.437004 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 00:33:17.437004 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 00:33:17.437004 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 00:33:17.437004 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 00:33:17.437004 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 00:33:17.437004 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 00:33:17.437004 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:33:17.437004 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 00:33:17.437004 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 00:33:17.437004 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 19 00:33:17.437004 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi Oct 19 00:33:17.437004 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:33:17.437004 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi Oct 19 00:33:17.437004 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:33:17.437004 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:33:17.437004 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:33:17.438281 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:33:17.438281 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:33:17.438281 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:33:17.438281 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:33:17.438281 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 00:33:17.438281 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:33:17.438281 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 19 00:33:17.438281 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi Oct 19 00:33:17.438281 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:33:17.438281 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi Oct 19 00:33:17.438281 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:33:17.438281 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:33:17.438281 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:33:17.438281 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:33:17.438281 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:33:17.438281 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 19 00:33:17.438281 dv-cinder-master-3-smb devstack@n-api.service[110500]: ERROR nova.api.openstack.wsgi Oct 19 00:33:17.438281 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-74cb4945-8183-4917-a56f-630cc4be671b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:33:17.439506 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-74cb4945-8183-4917-a56f-630cc4be671b admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012648 Oct 19 00:33:17.439506 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 27/52] 10.222.0.33 () {60 vars in 1193 bytes} [Wed Oct 19 00:33:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 00:33:18.660795 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-4c303d56-62a4-4b9c-a3ed-0cdd1490e3d2 admin admin] Calling method '>' {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:33:18.661805 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.requestlog [None req-4c303d56-62a4-4b9c-a3ed-0cdd1490e3d2 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 19 00:33:18.662204 dv-cinder-master-3-smb devstack@n-api.service[110501]: [pid: 110501|app: 0|req: 26/53] 10.222.0.33 () {56 vars in 1074 bytes} [Wed Oct 19 00:33:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:33:19.192069 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-da638824-7894-4555-801e-bef73a724377 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:33:19.211100 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-da638824-7894-4555-801e-bef73a724377 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.411793 Oct 19 00:33:19.212234 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 28/54] 10.222.0.33 () {64 vars in 1235 bytes} [Wed Oct 19 00:33:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:33:20.429229 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-4c303d56-62a4-4b9c-a3ed-0cdd1490e3d2 admin admin] Calling method '>' {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:33:20.431093 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.requestlog [None req-4c303d56-62a4-4b9c-a3ed-0cdd1490e3d2 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Oct 19 00:33:20.431488 dv-cinder-master-3-smb devstack@n-api.service[110501]: [pid: 110501|app: 0|req: 27/55] 10.222.0.33 () {56 vars in 1074 bytes} [Wed Oct 19 00:33:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:33:20.960525 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-e406ddb5-8258-4609-80c2-8cecccd1b9d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:33:20.979956 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-e406ddb5-8258-4609-80c2-8cecccd1b9d6 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.408359 Oct 19 00:33:20.980510 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 29/56] 10.222.0.33 () {64 vars in 1235 bytes} [Wed Oct 19 00:33:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:33:22.206700 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-4c303d56-62a4-4b9c-a3ed-0cdd1490e3d2 admin admin] Calling method '>' {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:33:22.207703 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.requestlog [None req-4c303d56-62a4-4b9c-a3ed-0cdd1490e3d2 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Oct 19 00:33:22.208145 dv-cinder-master-3-smb devstack@n-api.service[110501]: [pid: 110501|app: 0|req: 28/57] 10.222.0.33 () {56 vars in 1074 bytes} [Wed Oct 19 00:33:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:33:22.731406 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-1ec2c268-b4bd-4f59-a829-e3d658762bca admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:33:22.750805 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-1ec2c268-b4bd-4f59-a829-e3d658762bca admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.405181 Oct 19 00:33:22.751345 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 30/58] 10.222.0.33 () {64 vars in 1235 bytes} [Wed Oct 19 00:33:22 2022] POST /compute/v2.1/flavors => generated 407 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:33:23.965418 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-4c303d56-62a4-4b9c-a3ed-0cdd1490e3d2 admin admin] Calling method '>' {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:33:23.966418 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.requestlog [None req-4c303d56-62a4-4b9c-a3ed-0cdd1490e3d2 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Oct 19 00:33:23.966808 dv-cinder-master-3-smb devstack@n-api.service[110501]: [pid: 110501|app: 0|req: 29/59] 10.222.0.33 () {56 vars in 1074 bytes} [Wed Oct 19 00:33:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:33:24.491323 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-93a64368-026d-44f9-8336-d5085f3af9cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:33:24.510072 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-93a64368-026d-44f9-8336-d5085f3af9cc admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.405899 Oct 19 00:33:24.510605 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 31/60] 10.222.0.33 () {64 vars in 1235 bytes} [Wed Oct 19 00:33:24 2022] POST /compute/v2.1/flavors => generated 409 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:33:25.737566 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-4c303d56-62a4-4b9c-a3ed-0cdd1490e3d2 admin admin] Calling method '>' {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:33:25.738569 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.requestlog [None req-4c303d56-62a4-4b9c-a3ed-0cdd1490e3d2 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Oct 19 00:33:25.738965 dv-cinder-master-3-smb devstack@n-api.service[110501]: [pid: 110501|app: 0|req: 30/61] 10.222.0.33 () {56 vars in 1074 bytes} [Wed Oct 19 00:33:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:33:26.260908 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-10b6bdeb-351b-4e28-b193-6f03f431afa4 admin admin] Calling method '>' {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:33:26.281631 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-10b6bdeb-351b-4e28-b193-6f03f431afa4 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.407383 Oct 19 00:33:26.282190 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 32/62] 10.222.0.33 () {60 vars in 1202 bytes} [Wed Oct 19 00:33:25 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:34:23.010104 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-4c303d56-62a4-4b9c-a3ed-0cdd1490e3d2 admin admin] Calling method '>' {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:34:23.011116 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.requestlog [None req-4c303d56-62a4-4b9c-a3ed-0cdd1490e3d2 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Oct 19 00:34:23.011528 dv-cinder-master-3-smb devstack@n-api.service[110501]: [pid: 110501|app: 0|req: 31/63] 10.222.0.33 () {54 vars in 931 bytes} [Wed Oct 19 00:34:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:34:23.021896 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG dbcounter [-] [110500] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=110500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:23.400040 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-32fec071-6793-46a9-b85b-fb33063401ce admin admin] Calling method '>' {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:34:23.420484 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-32fec071-6793-46a9-b85b-fb33063401ce admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403071 Oct 19 00:34:23.421018 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 33/64] 10.222.0.33 () {60 vars in 1292 bytes} [Wed Oct 19 00:34:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:34:23.442940 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG dbcounter [-] [110501] Writing DB stats nova_api:SELECT=14 {{(pid=110501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:23.446748 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-c1d487eb-a7bf-482d-bf79-29019b4c5185 admin admin] Calling method '>' {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:34:23.454002 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.requestlog [None req-c1d487eb-a7bf-482d-bf79-29019b4c5185 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012619 Oct 19 00:34:23.454523 dv-cinder-master-3-smb devstack@n-api.service[110501]: [pid: 110501|app: 0|req: 32/65] 10.222.0.33 () {60 vars in 1283 bytes} [Wed Oct 19 00:34:23 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:34:23.466181 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-175d0978-4353-4352-9ac2-09c80214c5d4 admin admin] Calling method '>' {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:34:23.473305 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-175d0978-4353-4352-9ac2-09c80214c5d4 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010722 Oct 19 00:34:23.473816 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 34/66] 10.222.0.33 () {60 vars in 1286 bytes} [Wed Oct 19 00:34:23 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:34:23.485656 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-8af64fa8-077c-4fb7-b818-dda251f127c0 admin admin] Calling method '>' {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:34:23.493286 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.requestlog [None req-8af64fa8-077c-4fb7-b818-dda251f127c0 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011348 Oct 19 00:34:23.493798 dv-cinder-master-3-smb devstack@n-api.service[110501]: [pid: 110501|app: 0|req: 33/67] 10.222.0.33 () {60 vars in 1286 bytes} [Wed Oct 19 00:34:23 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:34:23.504850 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-c95a6729-9512-4159-87b0-51ec659002d3 admin admin] Calling method '>' {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:34:23.512311 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-c95a6729-9512-4159-87b0-51ec659002d3 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010840 Oct 19 00:34:23.512814 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 35/68] 10.222.0.33 () {60 vars in 1283 bytes} [Wed Oct 19 00:34:23 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:37:25.784314 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-8af64fa8-077c-4fb7-b818-dda251f127c0 admin admin] Calling method '>' {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:37:25.785319 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.requestlog [None req-8af64fa8-077c-4fb7-b818-dda251f127c0 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Oct 19 00:37:25.785713 dv-cinder-master-3-smb devstack@n-api.service[110501]: [pid: 110501|app: 0|req: 34/69] 10.222.0.33 () {56 vars in 1074 bytes} [Wed Oct 19 00:37:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:37:25.927067 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG dbcounter [-] [110500] Writing DB stats nova_api:SELECT=6 {{(pid=110500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:37:26.085298 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-232c9708-f831-418c-bdbf-c92b27eafe4c admin admin] Calling method '>' {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:37:26.090212 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG oslo_concurrency.lockutils [None req-232c9708-f831-418c-bdbf-c92b27eafe4c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:37:26.090693 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG oslo_concurrency.lockutils [None req-232c9708-f831-418c-bdbf-c92b27eafe4c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:37:26.091124 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG oslo_concurrency.lockutils [None req-232c9708-f831-418c-bdbf-c92b27eafe4c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:37:26.091842 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG oslo_concurrency.lockutils [None req-232c9708-f831-418c-bdbf-c92b27eafe4c admin admin] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:37:26.092313 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG oslo_concurrency.lockutils [None req-232c9708-f831-418c-bdbf-c92b27eafe4c admin admin] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:37:26.092734 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG oslo_concurrency.lockutils [None req-232c9708-f831-418c-bdbf-c92b27eafe4c admin admin] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:37:26.125482 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-232c9708-f831-418c-bdbf-c92b27eafe4c admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.92 time: 0.199638 Oct 19 00:37:26.126031 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 36/70] 10.222.0.33 () {60 vars in 1193 bytes} [Wed Oct 19 00:37:25 2022] GET /compute/v2.1/os-services => generated 785 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:37:27.223037 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-8af64fa8-077c-4fb7-b818-dda251f127c0 admin admin] Calling method '>' {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:37:27.224062 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.requestlog [None req-8af64fa8-077c-4fb7-b818-dda251f127c0 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Oct 19 00:37:27.224464 dv-cinder-master-3-smb devstack@n-api.service[110501]: [pid: 110501|app: 0|req: 35/71] 10.222.0.33 () {56 vars in 1074 bytes} [Wed Oct 19 00:37:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:37:27.418202 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-83aebc62-3e33-494e-bc84-d5d1662c19b7 admin admin] Calling method '>' {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:37:27.421574 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG oslo_concurrency.lockutils [None req-83aebc62-3e33-494e-bc84-d5d1662c19b7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:37:27.422049 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG oslo_concurrency.lockutils [None req-83aebc62-3e33-494e-bc84-d5d1662c19b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:37:27.422469 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG oslo_concurrency.lockutils [None req-83aebc62-3e33-494e-bc84-d5d1662c19b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:37:27.423179 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG oslo_concurrency.lockutils [None req-83aebc62-3e33-494e-bc84-d5d1662c19b7 admin admin] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:37:27.423610 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG oslo_concurrency.lockutils [None req-83aebc62-3e33-494e-bc84-d5d1662c19b7 admin admin] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:37:27.424055 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG oslo_concurrency.lockutils [None req-83aebc62-3e33-494e-bc84-d5d1662c19b7 admin admin] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:37:27.442931 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-83aebc62-3e33-494e-bc84-d5d1662c19b7 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.92 time: 0.077598 Oct 19 00:37:27.443413 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 37/72] 10.222.0.33 () {60 vars in 1193 bytes} [Wed Oct 19 00:37:27 2022] GET /compute/v2.1/os-services => generated 785 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:37:38.928603 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-8af64fa8-077c-4fb7-b818-dda251f127c0 admin admin] Calling method '>' {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:37:38.929604 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.requestlog [None req-8af64fa8-077c-4fb7-b818-dda251f127c0 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Oct 19 00:37:38.930000 dv-cinder-master-3-smb devstack@n-api.service[110501]: [pid: 110501|app: 0|req: 36/73] 10.222.0.33 () {56 vars in 1074 bytes} [Wed Oct 19 00:37:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:37:39.073158 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG dbcounter [-] [110500] Writing DB stats nova_cell0:SELECT=4 {{(pid=110500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:37:39.073876 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG dbcounter [-] [110500] Writing DB stats nova_cell1:SELECT=4 {{(pid=110500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:37:39.074490 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG dbcounter [-] [110500] Writing DB stats nova_api:SELECT=8 {{(pid=110500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:37:39.123388 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-e8a6548b-5a64-4139-a942-06e4870b0bd5 admin admin] Calling method '>' {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:37:39.126737 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG oslo_concurrency.lockutils [None req-e8a6548b-5a64-4139-a942-06e4870b0bd5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:37:39.127206 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG oslo_concurrency.lockutils [None req-e8a6548b-5a64-4139-a942-06e4870b0bd5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:37:39.127626 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG oslo_concurrency.lockutils [None req-e8a6548b-5a64-4139-a942-06e4870b0bd5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:37:39.128381 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG oslo_concurrency.lockutils [None req-e8a6548b-5a64-4139-a942-06e4870b0bd5 admin admin] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:37:39.128829 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG oslo_concurrency.lockutils [None req-e8a6548b-5a64-4139-a942-06e4870b0bd5 admin admin] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:37:39.129238 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG oslo_concurrency.lockutils [None req-e8a6548b-5a64-4139-a942-06e4870b0bd5 admin admin] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:37:39.153904 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-e8a6548b-5a64-4139-a942-06e4870b0bd5 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1005 microversion: 2.92 time: 0.085697 Oct 19 00:37:39.154380 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 38/74] 10.222.0.33 () {60 vars in 1193 bytes} [Wed Oct 19 00:37:39 2022] GET /compute/v2.1/os-services => generated 1005 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:37:40.231177 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG nova.api.openstack.wsgi [None req-8af64fa8-077c-4fb7-b818-dda251f127c0 admin admin] Calling method '>' {{(pid=110501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:37:40.232212 dv-cinder-master-3-smb devstack@n-api.service[110501]: INFO nova.api.openstack.requestlog [None req-8af64fa8-077c-4fb7-b818-dda251f127c0 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Oct 19 00:37:40.232874 dv-cinder-master-3-smb devstack@n-api.service[110501]: [pid: 110501|app: 0|req: 37/75] 10.222.0.33 () {56 vars in 1074 bytes} [Wed Oct 19 00:37:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:37:40.424186 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG nova.api.openstack.wsgi [None req-ace222f5-7c98-4450-be78-486602fcc798 admin admin] Calling method '>' {{(pid=110500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:37:40.430261 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG oslo_concurrency.lockutils [None req-ace222f5-7c98-4450-be78-486602fcc798 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:37:40.431088 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG oslo_concurrency.lockutils [None req-ace222f5-7c98-4450-be78-486602fcc798 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:37:40.431568 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG oslo_concurrency.lockutils [None req-ace222f5-7c98-4450-be78-486602fcc798 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:37:40.432772 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG oslo_concurrency.lockutils [None req-ace222f5-7c98-4450-be78-486602fcc798 admin admin] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:37:40.433241 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG oslo_concurrency.lockutils [None req-ace222f5-7c98-4450-be78-486602fcc798 admin admin] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:37:40.433638 dv-cinder-master-3-smb devstack@n-api.service[110500]: DEBUG oslo_concurrency.lockutils [None req-ace222f5-7c98-4450-be78-486602fcc798 admin admin] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:37:40.460420 dv-cinder-master-3-smb devstack@n-api.service[110500]: INFO nova.api.openstack.requestlog [None req-ace222f5-7c98-4450-be78-486602fcc798 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1005 microversion: 2.92 time: 0.088340 Oct 19 00:37:40.460901 dv-cinder-master-3-smb devstack@n-api.service[110500]: [pid: 110500|app: 0|req: 39/76] 10.222.0.33 () {60 vars in 1193 bytes} [Wed Oct 19 00:37:40 2022] GET /compute/v2.1/os-services => generated 1005 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:38:48.379071 dv-cinder-master-3-smb devstack@n-api.service[110499]: Wed Oct 19 00:38:48 2022 - graceful shutdown triggered... Oct 19 00:38:48.379589 dv-cinder-master-3-smb devstack@n-api.service[110501]: Gracefully killing worker 2 (pid: 110501)... Oct 19 00:38:48.379194 dv-cinder-master-3-smb systemd[1]: Stopping Devstack devstack@n-api.service... Oct 19 00:38:48.380441 dv-cinder-master-3-smb devstack@n-api.service[110500]: Gracefully killing worker 1 (pid: 110500)... Oct 19 00:38:48.504985 dv-cinder-master-3-smb devstack@n-api.service[110501]: DEBUG dbcounter [-] [110501] Writing DB stats nova_api:SELECT=4 {{(pid=110501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:38:49.380216 dv-cinder-master-3-smb devstack@n-api.service[110499]: worker 1 buried after 1 seconds Oct 19 00:38:49.380751 dv-cinder-master-3-smb devstack@n-api.service[110499]: worker 2 buried after 1 seconds Oct 19 00:38:49.380751 dv-cinder-master-3-smb devstack@n-api.service[110499]: goodbye to uWSGI. Oct 19 00:38:49.381787 dv-cinder-master-3-smb systemd[1]: devstack@n-api.service: Succeeded. Oct 19 00:38:49.382342 dv-cinder-master-3-smb systemd[1]: Stopped Devstack devstack@n-api.service. Oct 19 00:38:49.385126 dv-cinder-master-3-smb systemd[1]: Starting Devstack devstack@n-api.service... Oct 19 00:38:49.394299 dv-cinder-master-3-smb devstack@n-api.service[125515]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 19 00:38:49.397060 dv-cinder-master-3-smb devstack@n-api.service[125515]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 19 00:38:49 2022] *** Oct 19 00:38:49.397060 dv-cinder-master-3-smb devstack@n-api.service[125515]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 19 00:38:49.397060 dv-cinder-master-3-smb devstack@n-api.service[125515]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 19 00:38:49.397060 dv-cinder-master-3-smb devstack@n-api.service[125515]: nodename: dv-cinder-master-3-smb Oct 19 00:38:49.397060 dv-cinder-master-3-smb devstack@n-api.service[125515]: machine: x86_64 Oct 19 00:38:49.397060 dv-cinder-master-3-smb devstack@n-api.service[125515]: clock source: unix Oct 19 00:38:49.397060 dv-cinder-master-3-smb devstack@n-api.service[125515]: pcre jit disabled Oct 19 00:38:49.397060 dv-cinder-master-3-smb devstack@n-api.service[125515]: detected number of CPU cores: 4 Oct 19 00:38:49.397060 dv-cinder-master-3-smb devstack@n-api.service[125515]: current working directory: / Oct 19 00:38:49.397060 dv-cinder-master-3-smb devstack@n-api.service[125515]: detected binary path: /usr/bin/uwsgi-core Oct 19 00:38:49.397060 dv-cinder-master-3-smb devstack@n-api.service[125515]: your processes number limit is 47680 Oct 19 00:38:49.397060 dv-cinder-master-3-smb devstack@n-api.service[125515]: your memory page size is 4096 bytes Oct 19 00:38:49.397060 dv-cinder-master-3-smb devstack@n-api.service[125515]: detected max file descriptor number: 2048 Oct 19 00:38:49.397060 dv-cinder-master-3-smb devstack@n-api.service[125515]: lock engine: pthread robust mutexes Oct 19 00:38:49.398045 dv-cinder-master-3-smb devstack@n-api.service[125515]: thunder lock: enabled Oct 19 00:38:49.398045 dv-cinder-master-3-smb devstack@n-api.service[125515]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 19 00:38:49.398045 dv-cinder-master-3-smb devstack@n-api.service[125515]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 19 00:38:49.437929 dv-cinder-master-3-smb devstack@n-api.service[125515]: Python main interpreter initialized at 0x558a170299c0 Oct 19 00:38:49.437929 dv-cinder-master-3-smb devstack@n-api.service[125515]: python threads support enabled Oct 19 00:38:49.437929 dv-cinder-master-3-smb devstack@n-api.service[125515]: your server socket listen backlog is limited to 100 connections Oct 19 00:38:49.437929 dv-cinder-master-3-smb devstack@n-api.service[125515]: your mercy for graceful operations on workers is 90 seconds Oct 19 00:38:49.438369 dv-cinder-master-3-smb devstack@n-api.service[125515]: mapped 403077 bytes (393 KB) for 2 cores Oct 19 00:38:49.438369 dv-cinder-master-3-smb devstack@n-api.service[125515]: *** Operational MODE: preforking *** Oct 19 00:38:49.438664 dv-cinder-master-3-smb devstack@n-api.service[125515]: *** uWSGI is running in multiple interpreter mode *** Oct 19 00:38:49.438664 dv-cinder-master-3-smb devstack@n-api.service[125515]: spawned uWSGI master process (pid: 125515) Oct 19 00:38:49.438866 dv-cinder-master-3-smb systemd[1]: Started Devstack devstack@n-api.service. Oct 19 00:38:49.446542 dv-cinder-master-3-smb devstack@n-api.service[125515]: spawned uWSGI worker 1 (pid: 125531, cores: 1) Oct 19 00:38:49.446542 dv-cinder-master-3-smb devstack@n-api.service[125515]: spawned uWSGI worker 2 (pid: 125532, cores: 1) Oct 19 00:38:49.446542 dv-cinder-master-3-smb devstack@n-api.service[125515]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 19 00:38:50.105527 dv-cinder-master-3-smb devstack@n-api.service[125531]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 19 00:38:50.106157 dv-cinder-master-3-smb devstack@n-api.service[125532]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 19 00:38:51.262968 dv-cinder-master-3-smb devstack@n-api.service[125532]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 00:38:51.262968 dv-cinder-master-3-smb devstack@n-api.service[125532]: from cryptography.utils import int_from_bytes Oct 19 00:38:51.263688 dv-cinder-master-3-smb devstack@n-api.service[125532]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 00:38:51.263688 dv-cinder-master-3-smb devstack@n-api.service[125532]: from cryptography.utils import int_from_bytes Oct 19 00:38:51.276970 dv-cinder-master-3-smb devstack@n-api.service[125531]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 00:38:51.276970 dv-cinder-master-3-smb devstack@n-api.service[125531]: from cryptography.utils import int_from_bytes Oct 19 00:38:51.277521 dv-cinder-master-3-smb devstack@n-api.service[125531]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 00:38:51.277521 dv-cinder-master-3-smb devstack@n-api.service[125531]: from cryptography.utils import int_from_bytes Oct 19 00:38:53.662118 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 00:38:53.662699 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 00:38:53.662950 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 00:38:53.663183 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 00:38:53.663442 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 00:38:53.663841 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.664193 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.664523 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.665007 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.665344 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.665661 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.665990 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.666312 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.666641 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.666902 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.667218 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.667550 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.667943 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.668262 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.668509 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.668837 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.669139 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.669466 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.669776 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.670279 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.672338 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.672338 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.672547 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.672953 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.673271 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.673575 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.673902 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.674223 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.674539 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.674852 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.675269 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.675578 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.676025 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.676345 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.676767 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.677081 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.677399 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.677711 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.678040 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.678356 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.678682 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.679005 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.679323 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.679656 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.679971 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.680283 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.680590 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.680910 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.681221 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.681516 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.681766 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.682077 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.682401 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.682714 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.683037 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.683288 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.683536 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.683912 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.684201 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.684510 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.684818 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.685122 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.685226 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 00:38:53.685648 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.685726 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 00:38:53.685797 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.685984 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 00:38:53.686090 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.686301 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.686405 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 00:38:53.686558 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 00:38:53.686797 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.686978 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.687073 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.687372 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.687572 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.687805 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.688003 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.688212 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.688311 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.688560 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.688668 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.688878 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.688995 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.689206 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.689315 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.689517 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.689615 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.689856 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.690022 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.690186 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.690346 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.690500 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.690656 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.690808 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.690952 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.691113 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.691280 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.691453 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.691598 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.691749 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.691932 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.692093 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.692248 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.692398 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.692542 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.692699 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.692854 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.693014 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.693224 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.693390 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.693390 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.693678 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.693849 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.694005 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.694156 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.694329 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.694500 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.694656 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.694825 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.694998 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.695143 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.695286 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.695428 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.695578 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.695735 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.695898 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.696059 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.696212 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.696366 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.696509 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.696670 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.696823 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.696987 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.696987 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.697279 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.697432 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.697576 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.697729 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.697881 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.698024 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.698169 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.698321 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.699102 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.699271 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.699437 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.699582 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.699737 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.699916 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.700081 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.700239 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.700395 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.700549 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.700701 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.700845 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.700996 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.701149 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.701149 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.701442 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.701585 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.701735 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.701888 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.702047 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.702198 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.707866 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.708060 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.708215 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.708361 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.708556 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.708745 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.709280 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.709448 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.709603 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.709603 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.709893 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.710039 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.710039 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.710985 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.711140 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.711295 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.711448 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.711592 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.711736 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.712031 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.712195 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.712356 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.712502 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.712646 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.712802 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.712955 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.713185 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.713383 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.713540 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.713692 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.713845 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.714012 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.714173 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.714316 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.714466 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.714610 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.714760 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.714904 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.715061 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.715213 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.715357 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.715509 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.715653 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.715795 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.715993 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.716279 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.716452 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.716599 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.716744 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.716901 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.717056 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.717387 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.717545 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.717690 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.717845 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.718220 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.718484 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.718639 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.718786 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.718939 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.719084 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.719239 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.719384 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.719526 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.719679 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.719823 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.720011 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.720165 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.721029 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.721196 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.721343 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.721485 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.721643 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.721815 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.722069 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.722241 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.722398 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.722548 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.723321 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.723526 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.723686 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.723894 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.724060 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.724241 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.724402 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.724546 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.724697 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.724849 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.725001 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.725151 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.725310 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.725462 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.725606 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.725756 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.725925 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.726079 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.726224 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.726366 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.726510 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.726663 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.726815 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.726972 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.727116 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.727116 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.727434 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.727592 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.727745 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.727934 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.728093 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.728246 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.728390 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.728540 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.728720 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.728881 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.729036 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.729188 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.729331 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.729482 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.729636 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.729787 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.729949 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.731296 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.731455 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.731601 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.731601 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.731931 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.732091 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.732258 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.732422 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.732575 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.732720 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.732874 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.733020 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.734461 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.734628 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.734783 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.734946 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.735102 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.735256 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.735415 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.735560 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.735711 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.735875 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.736025 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.736188 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.736359 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.736514 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.736669 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.736821 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.736966 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.737119 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.737262 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.737415 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.737558 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.737708 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.737852 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.737996 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.738138 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.738301 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.738453 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.738597 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.738754 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.738898 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.739057 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.739249 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.739406 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.739559 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.739710 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.739978 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.740148 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.740301 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.740301 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.741084 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.741257 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.741726 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.741889 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.742034 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.742187 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.742331 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.742475 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.742624 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.742783 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:38:53.742928 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.742928 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.743230 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.743382 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.743581 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.743732 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.743904 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.744065 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.744218 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.744371 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.744597 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.744745 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.744896 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.745048 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.745218 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.745371 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.745526 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.745679 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.745824 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.745974 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.746133 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.746287 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.746440 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.746583 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.746726 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.746868 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.747011 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.747177 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.747322 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.747492 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.748125 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.748283 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.748437 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.748598 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.748743 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.748898 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.749042 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.749288 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.749450 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.749606 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.749762 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.749913 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.750058 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.750200 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.750358 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.750502 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.750671 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.751266 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.751445 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.751845 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.751845 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.752171 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.752327 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.752481 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.752634 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.752780 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.752934 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.753079 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.753222 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.753365 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.753508 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.753695 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.753874 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.754121 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.754272 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.754427 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.754580 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.754735 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.754880 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.755030 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.755174 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.755316 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.755458 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.755610 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.755762 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.755948 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.756098 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.756250 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.756411 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.756568 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.756712 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.756862 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.757007 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.757149 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.757299 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.757457 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.757610 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.757762 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.757905 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.758049 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.758202 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.758363 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.758514 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.758665 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.758808 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.758951 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.759104 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.759258 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.759409 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.759552 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.759694 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.759837 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.760018 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.760173 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.760316 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.760466 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.760609 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.760760 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.760930 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.761480 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.761643 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.761951 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.762121 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.762349 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.762517 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.762671 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.762671 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.762973 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.763118 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.763277 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.763430 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.763574 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.763762 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.763970 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.764127 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.764127 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.764421 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.764565 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.764708 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.765474 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.765641 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.765805 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.765949 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.766093 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.766236 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.766386 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.766530 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.766686 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.766838 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.766983 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.767125 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.767268 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.767432 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.767584 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.767740 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.767903 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.768131 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.768293 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.768455 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.768600 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.768749 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.768893 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.769468 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.770215 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.770376 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.770523 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.770677 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.770829 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.771683 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.771898 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.772158 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.772311 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.772593 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.772753 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.772898 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.773048 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.773205 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.773349 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.773508 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.773662 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.773855 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.774003 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.774147 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.774299 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.774452 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.774605 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.774750 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.774900 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.775062 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.775222 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.775366 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.775509 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.775667 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.775827 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.776010 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.776172 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.776323 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.776471 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.776628 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.776779 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.776929 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.777174 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.777335 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.777495 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.777656 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.777808 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.777958 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.778119 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.778269 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.778427 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.778585 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.778735 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.778900 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.779058 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.779220 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.779377 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.779527 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.779677 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.779841 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.780065 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.780218 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.780367 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.781126 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.781280 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.781921 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.782103 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.782103 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.782850 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.783026 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.783187 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.783349 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.783502 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.783652 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.783810 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.784190 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.784365 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.784519 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.784668 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.784777 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.784874 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.784961 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.785054 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.785149 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.785235 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.785320 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.785403 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.785495 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.785590 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.785684 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.785769 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.785853 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.785936 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.786020 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.786116 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.786209 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.786302 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.786393 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.786486 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.786570 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.786667 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.786760 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.786851 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.786851 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.787012 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.787111 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.787198 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.787281 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.787388 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.787480 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.787565 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.787659 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.787745 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.787829 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.787971 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.788068 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.788156 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.788250 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.788336 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.788336 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.788505 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.788598 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.788694 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.788790 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.788883 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.788968 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.789052 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.789136 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.789228 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.789322 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.789422 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.789515 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.789612 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.789700 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.789783 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.789866 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.789948 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.790031 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.790124 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.790217 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.790309 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.790393 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.790476 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.790573 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.790665 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.790757 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.790849 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.790941 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.791033 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.791127 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.791213 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.791304 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.791395 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.791480 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.791579 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.791957 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.792071 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.792167 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.792254 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.792355 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.792460 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.792557 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.792644 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.792729 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.792729 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.792916 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.792916 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.793091 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.793184 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.793278 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.793364 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.793455 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.793558 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.793645 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.793728 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.793820 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.793913 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.794005 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.794099 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.794232 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.794325 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.794411 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.794494 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.794593 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.794679 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.794770 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.794770 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.794923 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.795007 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.795134 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.795222 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.795306 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.795389 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.795472 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.795556 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.795649 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.795744 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.795828 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.795949 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.796093 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.796238 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.796341 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.796437 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.796531 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.796617 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.796702 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.796796 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.796882 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.796882 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.797032 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.797117 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.797209 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.797307 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.797401 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.797494 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.797587 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.797672 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.797764 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.797864 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.797950 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.798034 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.798118 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.798201 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.798285 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.798383 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.798469 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.798553 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.798645 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.798738 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.798832 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.798918 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.799002 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.799093 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.799093 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.799248 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.799402 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.799498 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.799583 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.799675 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.799760 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.799868 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.799974 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.800069 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.800156 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.800248 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.800340 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.800426 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.800520 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.800613 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.800706 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.800706 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.800869 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.800973 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.801067 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.801152 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.801236 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.801326 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.801411 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.801411 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.801577 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.801671 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.801764 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.801886 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.802112 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.802221 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.802308 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.802396 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.802481 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.802580 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.802666 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.802753 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.802826 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.802909 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.803066 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.803154 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.803238 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.803331 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.803406 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.803489 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.803582 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.803674 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.803759 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.803843 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.803952 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.804037 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.804141 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.804228 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.804340 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.804426 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.804524 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.804618 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.804717 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.804803 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.804893 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.804988 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.805087 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.805186 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.805280 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.805365 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.805449 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.805532 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.805623 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.805717 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.805798 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.805882 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.805980 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.806065 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.806157 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.806256 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.806344 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.806425 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.806498 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.806576 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.806655 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.806738 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.806811 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.806898 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.806973 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.807069 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.807216 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.807305 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.807378 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.807467 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.807467 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.807467 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.807670 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.807741 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.807993 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.808096 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.808254 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.808400 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.808529 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.808669 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.808839 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.808929 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.809147 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.809238 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.809462 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.809550 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.809775 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.809856 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.810087 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.810180 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.810546 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.810871 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.811435 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.811533 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.811679 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.812230 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.812386 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.812568 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.812665 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.812883 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.812987 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.813196 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.813289 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.813511 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.813614 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.813852 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.813982 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.814166 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.814278 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.814478 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.814577 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.814790 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.815039 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.815133 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.815227 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.815411 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.815513 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.815724 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.815818 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.816079 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.816168 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.816406 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.816515 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.816722 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.816820 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.817035 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.817117 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.817353 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.817438 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.817674 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.817774 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.817987 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.818080 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.818320 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.818412 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.818642 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.818750 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.818945 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.819037 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.819252 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.819384 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.819568 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.819698 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.819893 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.820052 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.820210 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.820368 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.820528 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.820679 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.820862 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.820991 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.821191 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.821312 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.821506 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.821608 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.821825 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.821926 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.822140 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.822489 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.822606 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.822689 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.822798 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.822922 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.823050 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.823237 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.823362 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.823543 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.823673 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.823914 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.824032 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.824193 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.824331 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.824507 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.824641 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.824817 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.824972 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.825123 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.825290 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.825428 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.825602 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.825755 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.825915 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.826064 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.826232 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.826388 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.826590 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.826814 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.826915 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.827193 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.827819 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.828117 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.828263 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.828447 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.828779 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.828885 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.829095 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.829196 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.829410 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.829517 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.829729 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.829820 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.830041 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.830142 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.830365 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.830532 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.830676 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.830779 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.830993 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.831086 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.831303 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.831404 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.831610 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.831702 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.831967 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.832072 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.832281 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.832538 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.832636 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.832727 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.832894 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.832986 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.833221 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.833315 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.833547 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.833639 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.833859 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.833951 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.834176 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.834284 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.834506 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.834628 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.834814 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.834922 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.835134 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.835228 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.835455 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.835548 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.835772 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.835893 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.836196 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.836315 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.836517 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.836619 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.836836 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.836939 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.837154 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.837248 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.837471 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.837571 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.837787 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.837890 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.838103 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.838196 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.838414 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.838520 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.838724 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.838817 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.839035 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.839128 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.839343 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.839442 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.839650 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.839775 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.839989 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.840085 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.840298 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.840404 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.840607 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.840707 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.840929 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.841048 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.841254 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.841371 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.841578 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.841672 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.841884 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.841978 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.842207 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.842302 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.842612 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.842720 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.842810 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.842989 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.843758 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.844111 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.844234 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.844434 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.844537 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.844788 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.844892 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.845104 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.845199 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.845430 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.845525 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.845754 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.845855 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.846067 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.846162 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.846387 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.846481 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.846724 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.846818 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.847037 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.847130 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.847347 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.847441 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.847660 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.847764 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.848012 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.848121 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.848326 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.848428 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.848641 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.848741 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.848950 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.849074 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.849263 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.849395 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.849570 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.849708 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.849879 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.850131 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.850234 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.850453 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.850547 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.850770 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.850871 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.851074 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.851166 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.851380 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.851474 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.851705 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.851800 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.852037 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.852142 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.852363 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.852458 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.852728 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.852846 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.852975 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.853142 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.853283 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.853378 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.853586 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.853688 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.853930 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.854029 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.854238 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.854339 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.854565 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.854657 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.854874 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.854975 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.855198 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.855293 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.855514 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.855608 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.855829 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.855959 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.856168 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.856287 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.856487 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.856599 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.856806 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.856934 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.857119 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.857215 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.857433 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.857537 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.857742 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.857847 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.858307 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.858420 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.858713 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.859000 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.859108 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.859347 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.859555 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.859651 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.859996 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.860181 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.860316 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.860518 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.860634 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.860845 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.860948 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.861166 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.861269 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.861485 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.861579 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.861803 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.861904 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.862122 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.862224 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.862438 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.862549 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.863328 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.863450 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.863554 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.863651 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.863739 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.863826 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.863930 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.864032 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.864121 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.864204 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.864336 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.864429 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.864650 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.864751 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.864963 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.865064 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.865281 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.865392 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.865597 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.865690 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.865914 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.866006 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.866253 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.866353 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.866578 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.866670 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.866887 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.866989 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.867203 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.867305 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.867518 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.867623 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.867833 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.867958 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.868195 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.868303 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.868521 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.868615 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.868857 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.868960 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.869172 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.869285 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.869485 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.869586 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.869803 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.869904 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.870116 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.870475 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.870475 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.870655 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.870748 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.870833 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.871028 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.871131 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.871337 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.871430 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.871649 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.871744 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.871989 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.872087 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.872303 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.872395 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.872618 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.872824 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.872949 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.873142 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.873250 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.873489 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.873597 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.873793 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.873901 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.874119 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.874582 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.874582 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.874814 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.874943 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.875151 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.875278 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.875467 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.875696 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.875798 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.876050 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.876169 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.876361 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.876500 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.876759 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.876967 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.877085 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.877288 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.877387 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.877600 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.877698 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.877958 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.878071 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.878277 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.878398 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.878585 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.878681 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.878899 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.879009 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.879208 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.879309 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.879746 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.879842 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.880118 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.880260 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.880439 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.880531 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.880755 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.880856 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.881074 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.881177 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.881392 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.881486 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.881702 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.881803 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.882018 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.882111 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.882330 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.882422 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.882639 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.882733 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.883896 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.884009 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.884009 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.884179 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.884268 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.884433 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.884526 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.884602 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.884674 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.884746 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.884831 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.884926 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.885014 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.885108 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.885237 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.885332 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.885427 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.885529 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.885657 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.885853 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.885958 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.886182 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.886290 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.886497 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.886593 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.886818 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.886910 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.887141 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.887238 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.887459 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.887562 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.887763 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.887879 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.888095 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.888447 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.888547 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.888690 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.888806 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.888920 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.889044 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.889141 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.889289 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.889390 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.889598 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.889701 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.890556 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.890663 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.890905 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.891257 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.891352 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.891575 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.891685 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.891919 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.892018 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.892234 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.892327 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.892545 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.892651 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.892865 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.893076 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.893175 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.893405 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.893510 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.893796 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.893891 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.894078 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.894183 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.894416 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.894520 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.894740 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.894846 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.895066 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.895282 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.895486 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.895630 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.895801 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.895979 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.896147 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.896318 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.896466 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.896653 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.896784 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.896966 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.897095 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.897278 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.897427 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.897587 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.897746 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.897915 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.898059 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.898229 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.898387 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.898544 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.898703 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.898856 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.899167 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.899267 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.899505 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.899603 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.899818 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.899943 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.900154 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.900266 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.900467 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.900570 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.900782 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.900877 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.901092 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.901196 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.901403 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.901509 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.901712 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.901817 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.902022 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.902126 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.902329 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.902432 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.902646 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.902741 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.902990 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.903085 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.903301 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.903406 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.903616 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.903727 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.903957 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.904052 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.904270 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.904355 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.904579 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.904660 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.904887 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.904977 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.905193 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.905350 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.906075 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.906202 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.906397 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.906824 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.906938 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.907152 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.907313 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.907465 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.907571 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.907779 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.907924 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.908122 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.908263 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.908435 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.908582 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.908755 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.908920 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.909067 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.909214 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.909385 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.909527 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.909695 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.909851 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.910010 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.910177 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.910365 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.910492 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.910681 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.910812 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.910992 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.911127 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.911324 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.911458 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.911636 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.911797 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.911973 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.912197 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.912300 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.912478 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.912601 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.912784 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.912930 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.913088 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.913249 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.913393 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.913566 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.913703 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.913922 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.914085 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.914245 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.914342 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.914609 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.914786 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.914957 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.915128 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.915231 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.915457 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.915551 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.915781 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.915944 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.916110 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.916217 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.916475 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.916614 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.916717 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.916820 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.917007 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.917111 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.917309 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.917411 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.917609 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.917705 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.917912 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.918015 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.918214 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.918308 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.918517 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.918619 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.918824 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.918919 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.919125 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.919222 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.919428 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.919523 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.919728 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.919867 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.920057 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.920194 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.920359 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.920465 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.920692 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.920787 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.921041 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.921210 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.921427 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.921807 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.921908 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.922134 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.922292 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.922488 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.922585 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.922816 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.922909 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.923140 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.923271 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.923464 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.923569 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.923786 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.923977 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.924180 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.924403 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.924519 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.924720 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.924830 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.925077 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.925187 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.925437 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.925623 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.925781 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.925936 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.926086 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.926190 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.926331 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.926433 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.926618 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.926799 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.926927 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.927120 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.927258 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.927449 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.927586 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.927798 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.927959 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.928143 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.928239 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.928493 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.928599 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.928825 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.928935 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.929146 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.929241 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.929464 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.929570 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.929779 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.929882 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.930091 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.930192 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.930400 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.930503 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.930706 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.930850 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.931014 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.931118 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.931334 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.931441 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.931648 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.931764 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.931981 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.932159 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.932297 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.932419 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.932621 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.932732 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.932936 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.933032 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.933258 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.933434 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.933699 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.933938 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.934067 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.934166 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.934313 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.934397 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.934556 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.934926 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.934926 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.935087 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.935196 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.935296 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.935532 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.935672 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.935831 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.936036 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.936235 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.936351 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.936569 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.936804 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.937104 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.937321 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.937430 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.937573 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 00:38:53.937761 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.938047 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.938361 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.938674 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.939023 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.939476 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.939882 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.940233 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.940580 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.940906 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.941239 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.941565 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.941897 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.942216 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.942546 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.942889 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.943202 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.943642 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.943876 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.944202 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.944521 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.944844 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.945160 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.945477 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.945796 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.946131 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.946470 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.946783 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.947114 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.947441 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.947770 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.948136 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.948457 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.948798 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.949120 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.949434 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.949751 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.950069 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.950387 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.950707 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.951023 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.951339 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.951660 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.952006 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.952863 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.953195 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.953511 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.953842 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.954177 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.954534 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.954859 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.955211 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.955547 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.955889 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.956212 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.956524 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:38:53.956778 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 00:38:54.001058 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO dbcounter [None req-79d10f28-c90c-4605-bdfc-d089881a76c2 None None] Registered counter for database nova_api Oct 19 00:38:54.019812 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO dbcounter [None req-80bcf884-5aad-4eb3-a0c4-65bbc4dce91f None None] Registered counter for database nova_api Oct 19 00:38:54.022132 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_db.sqlalchemy.engines [None req-79d10f28-c90c-4605-bdfc-d089881a76c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125532) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:38:54.028850 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writer thread running {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:38:54.040027 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_db.sqlalchemy.engines [None req-80bcf884-5aad-4eb3-a0c4-65bbc4dce91f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:38:54.046681 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writer thread running {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:38:54.086981 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.context [None req-79d10f28-c90c-4605-bdfc-d089881a76c2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab(cell1) {{(pid=125532) load_cells /opt/stack/nova/nova/context.py:464}} Oct 19 00:38:54.090987 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-79d10f28-c90c-4605-bdfc-d089881a76c2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:38:54.091462 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-79d10f28-c90c-4605-bdfc-d089881a76c2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:38:54.093198 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-79d10f28-c90c-4605-bdfc-d089881a76c2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:38:54.094338 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-79d10f28-c90c-4605-bdfc-d089881a76c2 None None] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:38:54.094781 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-79d10f28-c90c-4605-bdfc-d089881a76c2 None None] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:38:54.096823 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-79d10f28-c90c-4605-bdfc-d089881a76c2 None None] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:38:54.098794 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO dbcounter [None req-79d10f28-c90c-4605-bdfc-d089881a76c2 None None] Registered counter for database nova_cell0 Oct 19 00:38:54.102812 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO dbcounter [None req-79d10f28-c90c-4605-bdfc-d089881a76c2 None None] Registered counter for database nova_cell1 Oct 19 00:38:54.103235 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.context [None req-80bcf884-5aad-4eb3-a0c4-65bbc4dce91f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab(cell1) {{(pid=125531) load_cells /opt/stack/nova/nova/context.py:464}} Oct 19 00:38:54.107234 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-80bcf884-5aad-4eb3-a0c4-65bbc4dce91f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:38:54.107717 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-80bcf884-5aad-4eb3-a0c4-65bbc4dce91f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:38:54.109889 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-80bcf884-5aad-4eb3-a0c4-65bbc4dce91f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:38:54.110607 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_db.sqlalchemy.engines [None req-79d10f28-c90c-4605-bdfc-d089881a76c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125532) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:38:54.110806 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-80bcf884-5aad-4eb3-a0c4-65bbc4dce91f None None] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:38:54.111173 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-80bcf884-5aad-4eb3-a0c4-65bbc4dce91f None None] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:38:54.113129 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_db.sqlalchemy.engines [None req-79d10f28-c90c-4605-bdfc-d089881a76c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125532) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:38:54.113295 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-80bcf884-5aad-4eb3-a0c4-65bbc4dce91f None None] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:38:54.115211 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO dbcounter [None req-80bcf884-5aad-4eb3-a0c4-65bbc4dce91f None None] Registered counter for database nova_cell0 Oct 19 00:38:54.119333 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO dbcounter [None req-80bcf884-5aad-4eb3-a0c4-65bbc4dce91f None None] Registered counter for database nova_cell1 Oct 19 00:38:54.119467 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writer thread running {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:38:54.120706 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writer thread running {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:38:54.127977 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_db.sqlalchemy.engines [None req-80bcf884-5aad-4eb3-a0c4-65bbc4dce91f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:38:54.129358 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_db.sqlalchemy.engines [None req-80bcf884-5aad-4eb3-a0c4-65bbc4dce91f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:38:54.135970 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writer thread running {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:38:54.138125 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writer thread running {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:38:54.273116 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO dbcounter [None req-79d10f28-c90c-4605-bdfc-d089881a76c2 None None] Registered counter for database nova_cell0 Oct 19 00:38:54.280110 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_db.sqlalchemy.engines [None req-79d10f28-c90c-4605-bdfc-d089881a76c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125532) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:38:54.285354 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writer thread running {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:38:54.289868 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO dbcounter [None req-80bcf884-5aad-4eb3-a0c4-65bbc4dce91f None None] Registered counter for database nova_cell0 Oct 19 00:38:54.297455 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_db.sqlalchemy.engines [None req-80bcf884-5aad-4eb3-a0c4-65bbc4dce91f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:38:54.301963 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writer thread running {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:38:54.610206 dv-cinder-master-3-smb devstack@n-api.service[125532]: WARNING keystonemiddleware.auth_token [None req-79d10f28-c90c-4605-bdfc-d089881a76c2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 00:38:54.617673 dv-cinder-master-3-smb devstack@n-api.service[125532]: WARNING keystonemiddleware.auth_token [None req-79d10f28-c90c-4605-bdfc-d089881a76c2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 00:38:54.628420 dv-cinder-master-3-smb devstack@n-api.service[125531]: WARNING keystonemiddleware.auth_token [None req-80bcf884-5aad-4eb3-a0c4-65bbc4dce91f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 00:38:54.635766 dv-cinder-master-3-smb devstack@n-api.service[125531]: WARNING keystonemiddleware.auth_token [None req-80bcf884-5aad-4eb3-a0c4-65bbc4dce91f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 00:38:54.973783 dv-cinder-master-3-smb devstack@n-api.service[125532]: WARNING keystonemiddleware.auth_token [None req-79d10f28-c90c-4605-bdfc-d089881a76c2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 00:38:54.979743 dv-cinder-master-3-smb devstack@n-api.service[125532]: WARNING keystonemiddleware.auth_token [None req-79d10f28-c90c-4605-bdfc-d089881a76c2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 00:38:54.985955 dv-cinder-master-3-smb devstack@n-api.service[125532]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558a170299c0 pid: 125532 (default app) Oct 19 00:38:54.991916 dv-cinder-master-3-smb devstack@n-api.service[125531]: WARNING keystonemiddleware.auth_token [None req-80bcf884-5aad-4eb3-a0c4-65bbc4dce91f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 00:38:54.997912 dv-cinder-master-3-smb devstack@n-api.service[125531]: WARNING keystonemiddleware.auth_token [None req-80bcf884-5aad-4eb3-a0c4-65bbc4dce91f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 00:38:55.003418 dv-cinder-master-3-smb devstack@n-api.service[125531]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558a170299c0 pid: 125531 (default app) Oct 19 00:39:34.434933 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-6faa70d2-27ea-4e6f-8c34-77c4871f4ac4 tempest-VolumesTestJSON-854336377 tempest-VolumesTestJSON-854336377-project] Calling method '.version_select at 0x7f81f2051700>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:39:34.472641 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_api:SELECT=3 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:34.473751 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell1:SELECT=3 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:34.474786 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell0:SELECT=3 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:34.475953 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell0:SELECT=3 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:35.065777 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-6faa70d2-27ea-4e6f-8c34-77c4871f4ac4 tempest-VolumesTestJSON-854336377 tempest-VolumesTestJSON-854336377-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/98f4c83a-fdbf-4426-a286-de734eb7bdfd" status: 200 len: 351 microversion: 2.1 time: 0.946421 Oct 19 00:39:35.079510 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 1/1] 10.222.0.33 () {58 vars in 1245 bytes} [Wed Oct 19 00:39:34 2022] GET /compute/v2.1/os-volumes/98f4c83a-fdbf-4426-a286-de734eb7bdfd => generated 351 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:39:37.223901 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_api:SELECT=3 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:37.224886 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell0:SELECT=3 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:37.225769 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell1:SELECT=3 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:37.226820 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell0:SELECT=3 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:39:37.700718 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-0a52d45b-f3a8-4365-a063-fcddd3da5965 tempest-VolumesTestJSON-854336377 tempest-VolumesTestJSON-854336377-project] Calling method '.version_select at 0x7f81f1fee790>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:39:38.766624 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-0a52d45b-f3a8-4365-a063-fcddd3da5965 tempest-VolumesTestJSON-854336377 tempest-VolumesTestJSON-854336377-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f1a14966-2ede-4fd4-9f0e-ec7da665724c" status: 200 len: 350 microversion: 2.1 time: 1.547859 Oct 19 00:39:38.775971 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 1/2] 10.222.0.33 () {58 vars in 1245 bytes} [Wed Oct 19 00:39:37 2022] GET /compute/v2.1/os-volumes/f1a14966-2ede-4fd4-9f0e-ec7da665724c => generated 350 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:39:40.503249 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-0800335c-4608-4068-b030-599268fb14f3 tempest-VolumesTestJSON-854336377 tempest-VolumesTestJSON-854336377-project] Calling method '.version_select at 0x7f81f1e94a60>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:39:40.617215 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-0800335c-4608-4068-b030-599268fb14f3 tempest-VolumesTestJSON-854336377 tempest-VolumesTestJSON-854336377-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/dcbff7f4-4052-4583-8742-f7a021368b96" status: 200 len: 351 microversion: 2.1 time: 0.118565 Oct 19 00:39:40.628911 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 2/3] 10.222.0.33 () {58 vars in 1245 bytes} [Wed Oct 19 00:39:40 2022] GET /compute/v2.1/os-volumes/dcbff7f4-4052-4583-8742-f7a021368b96 => generated 351 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:39:40.633546 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-03a3c597-308f-45f6-8913-c498d9e2e3a8 tempest-VolumesTestJSON-854336377 tempest-VolumesTestJSON-854336377-project] Calling method '.version_select at 0x7f81f1eb3940>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:39:40.826220 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-03a3c597-308f-45f6-8913-c498d9e2e3a8 tempest-VolumesTestJSON-854336377 tempest-VolumesTestJSON-854336377-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.198384 Oct 19 00:39:40.827483 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 2/4] 10.222.0.33 () {58 vars in 1134 bytes} [Wed Oct 19 00:39:40 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:39:40.845094 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-076fb100-4249-4b4a-b77e-edaa8334de74 tempest-VolumesTestJSON-854336377 tempest-VolumesTestJSON-854336377-project] Calling method '.version_select at 0x7f81f1e94af0>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:39:41.057030 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-076fb100-4249-4b4a-b77e-edaa8334de74 tempest-VolumesTestJSON-854336377 tempest-VolumesTestJSON-854336377-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.216992 Oct 19 00:39:41.057601 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 3/5] 10.222.0.33 () {58 vars in 1149 bytes} [Wed Oct 19 00:39:40 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:39:41.073191 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-74ac633d-fb69-477f-818a-208d87bed7f2 tempest-VolumesTestJSON-854336377 tempest-VolumesTestJSON-854336377-project] Calling method '.version_select at 0x7f81f1e73700>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:39:41.370895 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-74ac633d-fb69-477f-818a-208d87bed7f2 tempest-VolumesTestJSON-854336377 tempest-VolumesTestJSON-854336377-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.301599 Oct 19 00:39:41.371638 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 3/6] 10.222.0.33 () {58 vars in 1134 bytes} [Wed Oct 19 00:39:41 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:39:41.385792 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-bb46ccea-75ea-4c13-a411-8f201915074c tempest-VolumesTestJSON-854336377 tempest-VolumesTestJSON-854336377-project] Calling method '.version_select at 0x7f81f1e94ee0>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:39:41.552163 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-bb46ccea-75ea-4c13-a411-8f201915074c tempest-VolumesTestJSON-854336377 tempest-VolumesTestJSON-854336377-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.170041 Oct 19 00:39:41.562806 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 4/7] 10.222.0.33 () {58 vars in 1167 bytes} [Wed Oct 19 00:39:41 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:39:41.568896 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-348ac942-c626-4669-8bfd-408260589025 tempest-VolumesTestJSON-854336377 tempest-VolumesTestJSON-854336377-project] Calling method '.version_select at 0x7f81f1e0bc10>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:39:41.928757 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-348ac942-c626-4669-8bfd-408260589025 tempest-VolumesTestJSON-854336377 tempest-VolumesTestJSON-854336377-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.364705 Oct 19 00:39:41.930036 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 4/8] 10.222.0.33 () {58 vars in 1170 bytes} [Wed Oct 19 00:39:41 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:39:41.944161 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-695f89a0-ea43-4f6d-b336-3c10a4ec93b2 tempest-VolumesTestJSON-854336377 tempest-VolumesTestJSON-854336377-project] Calling method '.version_select at 0x7f81f1e72dc0>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:39:42.130230 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-695f89a0-ea43-4f6d-b336-3c10a4ec93b2 tempest-VolumesTestJSON-854336377 tempest-VolumesTestJSON-854336377-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.190095 Oct 19 00:39:42.140069 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 5/9] 10.222.0.33 () {58 vars in 1155 bytes} [Wed Oct 19 00:39:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:39:42.147109 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-de9c8bb8-5439-4d1d-9efa-26d0983013da tempest-VolumesTestJSON-854336377 tempest-VolumesTestJSON-854336377-project] Calling method '.version_select at 0x7f81f1e0b9d0>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:39:42.440291 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-de9c8bb8-5439-4d1d-9efa-26d0983013da tempest-VolumesTestJSON-854336377 tempest-VolumesTestJSON-854336377-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.298777 Oct 19 00:39:42.447669 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 5/10] 10.222.0.33 () {58 vars in 1188 bytes} [Wed Oct 19 00:39:42 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:39:42.464564 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-d1cdf79b-b29b-4c45-a3bc-af7cc6ab7ac6 tempest-VolumesTestJSON-854336377 tempest-VolumesTestJSON-854336377-project] Calling method '.version_select at 0x7f81f1e72c10>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:39:42.727406 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-d1cdf79b-b29b-4c45-a3bc-af7cc6ab7ac6 tempest-VolumesTestJSON-854336377 tempest-VolumesTestJSON-854336377-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.269443 Oct 19 00:39:42.728045 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 6/11] 10.222.0.33 () {58 vars in 1155 bytes} [Wed Oct 19 00:39:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:39:48.814885 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-c7929ea7-56c5-438c-9feb-1a6ce9d6a1ee tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Action: 'create', calling method: .version_select at 0x7f81f1e738b0>, body: {"keypair": {"name": "tempest-keypair-1836100858", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkQK+UldGr2dX4BSnGNBfv12oEpXV+XYQRdOm8F1k9aD1A0RJreYHDK50o/8W9VYtXTxYzuhPHZbFm0DOHczFj5YGloh1Wdzx1iaVK/f0U83lDKuFvPuPe+Q+PUpkJH3g=="}} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:39:48.929114 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.quota [None req-c7929ea7-56c5-438c-9feb-1a6ce9d6a1ee tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Getting quotas for project 5e171056a4354ca695c18f115bfb750f. Resources: {'key_pairs'} {{(pid=125531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:39:48.944640 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.quota [None req-c7929ea7-56c5-438c-9feb-1a6ce9d6a1ee tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Getting quotas for user 59bad833caf84817b8553d699b2fa04f and project 5e171056a4354ca695c18f115bfb750f. Resources: {'key_pairs'} {{(pid=125531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:39:49.052682 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-c7929ea7-56c5-438c-9feb-1a6ce9d6a1ee tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.592864 Oct 19 00:39:49.054004 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 6/12] 10.222.0.33 () {62 vars in 1200 bytes} [Wed Oct 19 00:39:48 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 595 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 19 00:39:50.747252 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-7b77459c-f27e-475a-9595-d877f1598b8d tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1438903866", "imageRef": "d1f4abc9-3bb9-4343-9a05-53d758070c9d", "flavorRef": "452", "networks": [{"uuid": "ac98ca82-29a6-4ed0-bbb5-9c232052f01c"}]}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:39:50.933301 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.network.neutron [None req-7b77459c-f27e-475a-9595-d877f1598b8d tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] validate_networks() for [('ac98ca82-29a6-4ed0-bbb5-9c232052f01c', None, None, None, None, None)] {{(pid=125532) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:39:53.042795 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-7b77459c-f27e-475a-9595-d877f1598b8d tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Flavor limits 0:0:0 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:39:53.044015 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-7b77459c-f27e-475a-9595-d877f1598b8d tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Image limits 0:0:0 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:39:53.044742 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-7b77459c-f27e-475a-9595-d877f1598b8d tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Flavor pref 0:0:0 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:39:53.045426 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-7b77459c-f27e-475a-9595-d877f1598b8d tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Image pref 0:0:0 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:39:53.045971 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-7b77459c-f27e-475a-9595-d877f1598b8d tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:39:53.083046 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7b77459c-f27e-475a-9595-d877f1598b8d tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:39:53.083868 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7b77459c-f27e-475a-9595-d877f1598b8d tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:39:53.084505 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7b77459c-f27e-475a-9595-d877f1598b8d tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:39:53.085400 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7b77459c-f27e-475a-9595-d877f1598b8d tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:39:53.087787 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7b77459c-f27e-475a-9595-d877f1598b8d tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:39:53.088656 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7b77459c-f27e-475a-9595-d877f1598b8d tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:39:53.180333 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.quota [None req-7b77459c-f27e-475a-9595-d877f1598b8d tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Getting quotas for project dfb46376a666496b896ad085315c58fd. Resources: {'instances', 'cores', 'ram'} {{(pid=125532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:39:53.195783 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.quota [None req-7b77459c-f27e-475a-9595-d877f1598b8d tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Getting quotas for user dda9dd9eb8d3446c96b0c702dd09d2fa and project dfb46376a666496b896ad085315c58fd. Resources: {'instances', 'cores', 'ram'} {{(pid=125532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:39:53.241977 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-7b77459c-f27e-475a-9595-d877f1598b8d tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Going to run 1 instances... {{(pid=125532) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:39:53.250292 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-7b77459c-f27e-475a-9595-d877f1598b8d tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1f4abc9-3bb9-4343-9a05-53d758070c9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125532) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:39:53.463439 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-7b77459c-f27e-475a-9595-d877f1598b8d tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.014001 Oct 19 00:39:53.465133 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 7/13] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Oct 19 00:39:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 3016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:39:53.477841 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-1aae0055-74af-4c60-99b7-931c63c0b8b8 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:39:53.478476 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-1aae0055-74af-4c60-99b7-931c63c0b8b8 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:39:53.767539 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-1aae0055-74af-4c60-99b7-931c63c0b8b8 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda9dd9eb8d3446c96b0c702dd09d2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb46376a666496b896ad085315c58fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:39:53.804582 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-1aae0055-74af-4c60-99b7-931c63c0b8b8 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641" status: 200 len: 1215 microversion: 2.1 time: 0.331078 Oct 19 00:39:53.806545 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 8/14] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:39:53 2022] GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 => generated 1215 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:39:53.822890 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-54e34633-8501-4d67-97ab-0e640a08da44 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-175683146", "imageRef": "d1f4abc9-3bb9-4343-9a05-53d758070c9d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f6e68d02-c832-4157-afd5-6714e9e0f718"}], "security_groups": [{"name": "tempest-securitygroup--1495005258"}], "key_name": "tempest-keypair-1836100858", "user_data": "}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:39:54.156215 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-e01b12e0-c5f5-4f60-b7d0-31a2e6308712 tempest-VolumesNegativeTest-403294352 tempest-VolumesNegativeTest-403294352-project] Action: 'create', calling method: .version_select at 0x7f81f1dd5790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1475486975", "metadata": {"Type": "work"}}} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:39:54.161536 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-e01b12e0-c5f5-4f60-b7d0-31a2e6308712 tempest-VolumesNegativeTest-403294352 tempest-VolumesNegativeTest-403294352-project] Request method failure captured: Oct 19 00:39:54.161536 dv-cinder-master-3-smb devstack@n-api.service[125531]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 19 00:39:54.161536 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept: application/json Oct 19 00:39:54.161536 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept-Encoding: identity Oct 19 00:39:54.161536 dv-cinder-master-3-smb devstack@n-api.service[125531]: Connection: close Oct 19 00:39:54.161536 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Length: 122 Oct 19 00:39:54.161536 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Type: application/json Oct 19 00:39:54.161536 dv-cinder-master-3-smb devstack@n-api.service[125531]: Host: 10.222.0.33 Oct 19 00:39:54.161536 dv-cinder-master-3-smb devstack@n-api.service[125531]: Openstack-System-Scope: None Oct 19 00:39:54.161536 dv-cinder-master-3-smb devstack@n-api.service[125531]: User-Agent: python-urllib3/1.26.12 Oct 19 00:39:54.161536 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Auth-Token: gAAAAABjT0dYeFvQuaqEsw0ZiPj-Yb1-f-2xX_eGYpcOxdy5BlBASPb-qCF5BUrUbFqlocleRoRS-e2WSrarme2uGTasbmP0rqMgrdhE-yT0uVCYjV7T9M1sGJp4vGy5HdXv8WrbubDJ9u88RW46NfZpt1WpR1wowE9GWi1Z9lPeRbaehHwS12Q Oct 19 00:39:54.161536 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Id: None Oct 19 00:39:54.161536 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Name: None Oct 19 00:39:54.161536 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Identity-Status: Confirmed Oct 19 00:39:54.161536 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Is-Admin-Project: True Oct 19 00:39:54.161536 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Id: default Oct 19 00:39:54.161536 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Name: Default Oct 19 00:39:54.161536 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Id: caee808a710b4e52858ef4be7b1e555a Oct 19 00:39:54.161536 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Name: tempest-VolumesNegativeTest-403294352 Oct 19 00:39:54.161536 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Role: member,reader Oct 19 00:39:54.161536 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Roles: member,reader Oct 19 00:39:54.163071 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_caee808a710b4e52858ef4be7b1e555a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/caee808a710b4e52858ef4be7b1e555a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/caee808a710b4e52858ef4be7b1e555a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/caee808a710b4e52858ef4be7b1e555a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:39:54.163071 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant: tempest-VolumesNegativeTest-403294352 Oct 19 00:39:54.163071 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Id: caee808a710b4e52858ef4be7b1e555a Oct 19 00:39:54.163071 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Name: tempest-VolumesNegativeTest-403294352 Oct 19 00:39:54.163071 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User: tempest-VolumesNegativeTest-403294352-project Oct 19 00:39:54.163071 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Id: default Oct 19 00:39:54.163071 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Name: Default Oct 19 00:39:54.163071 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Id: 4c5ae97b5ab2408f9b60ec26d5d45856 Oct 19 00:39:54.163071 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Name: tempest-VolumesNegativeTest-403294352-project Oct 19 00:39:54.163071 dv-cinder-master-3-smb devstack@n-api.service[125531]: Oct 19 00:39:54.163071 dv-cinder-master-3-smb devstack@n-api.service[125531]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1475486975", "metadata": {"Type": "work"}}} Oct 19 00:39:54.163071 dv-cinder-master-3-smb devstack@n-api.service[125531]: method: Oct 19 00:39:54.163071 dv-cinder-master-3-smb devstack@n-api.service[125531]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 19 00:39:54.164003 dv-cinder-master-3-smb devstack@n-api.service[125531]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1475486975', 'metadata': {'Type': 'work'}}}} Oct 19 00:39:54.164003 dv-cinder-master-3-smb devstack@n-api.service[125531]: {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:39:54.164003 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:39:54.164003 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 00:39:54.164003 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 00:39:54.164003 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 00:39:54.164003 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise error Oct 19 00:39:54.164003 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 19 00:39:54.164003 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:39:54.164003 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 19 00:39:54.164003 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 19 00:39:54.164003 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:39:54.164003 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 19 00:39:54.164003 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi '#$%' Oct 19 00:39:54.164003 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:39:54.164003 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:39:54.164003 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:39:54.164003 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:39:54.164003 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:39:54.164003 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:39:54.164003 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:39:54.164003 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:39:54.165736 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:39:54.165736 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:39:54.165736 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:39:54.165736 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:39:54.165736 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 00:39:54.165736 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 00:39:54.165736 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 00:39:54.165736 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 00:39:54.165736 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 00:39:54.165736 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 00:39:54.165736 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 19 00:39:54.165736 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:39:54.165736 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:39:54.165736 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:39:54.165736 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:39:54.165736 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:39:54.165736 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:39:54.165736 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 00:39:54.165736 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 00:39:54.167055 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 19 00:39:54.167055 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:39:54.168429 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-e01b12e0-c5f5-4f60-b7d0-31a2e6308712 tempest-VolumesNegativeTest-403294352 tempest-VolumesNegativeTest-403294352-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=125531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:39:54.169317 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-e01b12e0-c5f5-4f60-b7d0-31a2e6308712 tempest-VolumesNegativeTest-403294352 tempest-VolumesNegativeTest-403294352-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.073684 Oct 19 00:39:54.169888 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 7/15] 10.222.0.33 () {60 vars in 1156 bytes} [Wed Oct 19 00:39:53 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1075 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 19 00:39:54.215700 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.network.neutron [None req-54e34633-8501-4d67-97ab-0e640a08da44 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] validate_networks() for [('f6e68d02-c832-4157-afd5-6714e9e0f718', None, None, None, None, None)] {{(pid=125532) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:39:54.532677 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-41344895-4d93-4139-af81-1f23f2f0eecc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Action: 'create', calling method: .version_select at 0x7f81f1e0bf70>, body: {"keypair": {"name": "tempest-keypair-998982525", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7h0wfLzBvz1GqvnePLrRJaPVbikLn3Ln6CqdDelJC1Lr7M4C9Q8fRkc8LQGZuO8aCRWBGBLjsIuUpn0fNfgCJHrsQJXMysyt2lZ2OYNG20rxXwl+/rN3JfyFz+GvyX1A=="}} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:39:54.571461 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.quota [None req-41344895-4d93-4139-af81-1f23f2f0eecc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Getting quotas for project 4081d4f735b04367a67a03b9539f5432. Resources: {'key_pairs'} {{(pid=125531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:39:54.582989 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.quota [None req-41344895-4d93-4139-af81-1f23f2f0eecc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Getting quotas for user 5f9a55c605f04f478d0a71679d8bf6a1 and project 4081d4f735b04367a67a03b9539f5432. Resources: {'key_pairs'} {{(pid=125531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:39:54.651807 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-41344895-4d93-4139-af81-1f23f2f0eecc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.480309 Oct 19 00:39:54.652868 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 8/16] 10.222.0.33 () {60 vars in 1159 bytes} [Wed Oct 19 00:39:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:39:54.666501 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-37b29ad9-25ff-4889-b9f8-a0d13f863b90 tempest-VolumesNegativeTest-403294352 tempest-VolumesNegativeTest-403294352-project] Action: 'create', calling method: .version_select at 0x7f81f1dbb5e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-521124685", "metadata": {"Type": "work"}}} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:39:54.678390 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-37b29ad9-25ff-4889-b9f8-a0d13f863b90 tempest-VolumesNegativeTest-403294352 tempest-VolumesNegativeTest-403294352-project] Request method failure captured: Oct 19 00:39:54.678390 dv-cinder-master-3-smb devstack@n-api.service[125531]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 19 00:39:54.678390 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept: application/json Oct 19 00:39:54.678390 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept-Encoding: identity Oct 19 00:39:54.678390 dv-cinder-master-3-smb devstack@n-api.service[125531]: Connection: close Oct 19 00:39:54.678390 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Length: 119 Oct 19 00:39:54.678390 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Type: application/json Oct 19 00:39:54.678390 dv-cinder-master-3-smb devstack@n-api.service[125531]: Host: 10.222.0.33 Oct 19 00:39:54.678390 dv-cinder-master-3-smb devstack@n-api.service[125531]: Openstack-System-Scope: None Oct 19 00:39:54.678390 dv-cinder-master-3-smb devstack@n-api.service[125531]: User-Agent: python-urllib3/1.26.12 Oct 19 00:39:54.678390 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Auth-Token: gAAAAABjT0dYeFvQuaqEsw0ZiPj-Yb1-f-2xX_eGYpcOxdy5BlBASPb-qCF5BUrUbFqlocleRoRS-e2WSrarme2uGTasbmP0rqMgrdhE-yT0uVCYjV7T9M1sGJp4vGy5HdXv8WrbubDJ9u88RW46NfZpt1WpR1wowE9GWi1Z9lPeRbaehHwS12Q Oct 19 00:39:54.678390 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Id: None Oct 19 00:39:54.678390 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Name: None Oct 19 00:39:54.678390 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Identity-Status: Confirmed Oct 19 00:39:54.678390 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Is-Admin-Project: True Oct 19 00:39:54.678390 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Id: default Oct 19 00:39:54.678390 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Name: Default Oct 19 00:39:54.678390 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Id: caee808a710b4e52858ef4be7b1e555a Oct 19 00:39:54.678390 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Name: tempest-VolumesNegativeTest-403294352 Oct 19 00:39:54.678390 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Role: member,reader Oct 19 00:39:54.678390 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Roles: member,reader Oct 19 00:39:54.679655 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_caee808a710b4e52858ef4be7b1e555a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/caee808a710b4e52858ef4be7b1e555a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/caee808a710b4e52858ef4be7b1e555a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/caee808a710b4e52858ef4be7b1e555a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:39:54.679655 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant: tempest-VolumesNegativeTest-403294352 Oct 19 00:39:54.679655 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Id: caee808a710b4e52858ef4be7b1e555a Oct 19 00:39:54.679655 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Name: tempest-VolumesNegativeTest-403294352 Oct 19 00:39:54.679655 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User: tempest-VolumesNegativeTest-403294352-project Oct 19 00:39:54.679655 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Id: default Oct 19 00:39:54.679655 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Name: Default Oct 19 00:39:54.679655 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Id: 4c5ae97b5ab2408f9b60ec26d5d45856 Oct 19 00:39:54.679655 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Name: tempest-VolumesNegativeTest-403294352-project Oct 19 00:39:54.679655 dv-cinder-master-3-smb devstack@n-api.service[125531]: Oct 19 00:39:54.679655 dv-cinder-master-3-smb devstack@n-api.service[125531]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-521124685", "metadata": {"Type": "work"}}} Oct 19 00:39:54.679655 dv-cinder-master-3-smb devstack@n-api.service[125531]: method: Oct 19 00:39:54.679655 dv-cinder-master-3-smb devstack@n-api.service[125531]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 19 00:39:54.680465 dv-cinder-master-3-smb devstack@n-api.service[125531]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-521124685', 'metadata': {'Type': 'work'}}}} Oct 19 00:39:54.680465 dv-cinder-master-3-smb devstack@n-api.service[125531]: {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:39:54.680465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:39:54.680465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 00:39:54.680465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 00:39:54.680465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 00:39:54.680465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise error Oct 19 00:39:54.680465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 19 00:39:54.680465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:39:54.680465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 19 00:39:54.680465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 19 00:39:54.680465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:39:54.680465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 19 00:39:54.680465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi '0' Oct 19 00:39:54.680465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:39:54.680465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:39:54.680465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:39:54.680465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:39:54.680465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:39:54.680465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:39:54.680465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:39:54.680465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:39:54.681670 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:39:54.681670 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:39:54.681670 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:39:54.681670 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:39:54.681670 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 00:39:54.681670 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 00:39:54.681670 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 00:39:54.681670 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 00:39:54.681670 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 00:39:54.681670 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 00:39:54.681670 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 19 00:39:54.681670 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:39:54.681670 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:39:54.681670 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:39:54.681670 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:39:54.681670 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:39:54.681670 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:39:54.681670 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 00:39:54.681670 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 00:39:54.682799 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 19 00:39:54.682799 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:39:54.688631 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-37b29ad9-25ff-4889-b9f8-a0d13f863b90 tempest-VolumesNegativeTest-403294352 tempest-VolumesNegativeTest-403294352-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=125531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:39:54.698117 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-37b29ad9-25ff-4889-b9f8-a0d13f863b90 tempest-VolumesNegativeTest-403294352 tempest-VolumesNegativeTest-403294352-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.031484 Oct 19 00:39:54.702685 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 9/17] 10.222.0.33 () {60 vars in 1156 bytes} [Wed Oct 19 00:39:54 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:39:54.881108 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-32b0025e-30c2-4495-9b8d-02c54ebb4bb2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1161841880", "imageRef": "d1f4abc9-3bb9-4343-9a05-53d758070c9d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:39:55.043028 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.network.neutron [None req-32b0025e-30c2-4495-9b8d-02c54ebb4bb2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] validate_networks() for [('ea4fbcd4-f89f-4128-8b67-a27e8fce8a1a', None, None, None, None, None)] {{(pid=125531) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:39:55.300564 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-54e34633-8501-4d67-97ab-0e640a08da44 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Flavor limits 0:0:0 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:39:55.301095 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-54e34633-8501-4d67-97ab-0e640a08da44 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Image limits 0:0:0 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:39:55.301464 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-54e34633-8501-4d67-97ab-0e640a08da44 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Flavor pref 0:0:0 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:39:55.301894 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-54e34633-8501-4d67-97ab-0e640a08da44 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Image pref 0:0:0 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:39:55.302307 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-54e34633-8501-4d67-97ab-0e640a08da44 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:39:55.314861 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-54e34633-8501-4d67-97ab-0e640a08da44 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:39:55.316471 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-54e34633-8501-4d67-97ab-0e640a08da44 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:39:55.317052 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-54e34633-8501-4d67-97ab-0e640a08da44 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:39:55.318055 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-54e34633-8501-4d67-97ab-0e640a08da44 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:39:55.319227 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-54e34633-8501-4d67-97ab-0e640a08da44 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:39:55.320097 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-54e34633-8501-4d67-97ab-0e640a08da44 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:39:55.353363 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.quota [None req-54e34633-8501-4d67-97ab-0e640a08da44 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Getting quotas for project 5e171056a4354ca695c18f115bfb750f. Resources: {'instances', 'cores', 'ram'} {{(pid=125532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:39:55.365523 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.quota [None req-54e34633-8501-4d67-97ab-0e640a08da44 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Getting quotas for user 59bad833caf84817b8553d699b2fa04f and project 5e171056a4354ca695c18f115bfb750f. Resources: {'instances', 'cores', 'ram'} {{(pid=125532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:39:55.415266 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-54e34633-8501-4d67-97ab-0e640a08da44 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Going to run 1 instances... {{(pid=125532) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:39:55.429388 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-54e34633-8501-4d67-97ab-0e640a08da44 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1f4abc9-3bb9-4343-9a05-53d758070c9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125532) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:39:55.548712 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-54e34633-8501-4d67-97ab-0e640a08da44 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.740606 Oct 19 00:39:55.549375 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 9/18] 10.222.0.33 () {62 vars in 1188 bytes} [Wed Oct 19 00:39:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 1742 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 00:39:55.561959 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-d82a7f7b-f51d-45a9-aca1-17e4c100f14a tempest-VolumesNegativeTest-403294352 tempest-VolumesNegativeTest-403294352-project] Action: 'create', calling method: .version_select at 0x7f81f153f5e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1296250347", "metadata": {"Type": "work"}}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:39:55.579835 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-d82a7f7b-f51d-45a9-aca1-17e4c100f14a tempest-VolumesNegativeTest-403294352 tempest-VolumesNegativeTest-403294352-project] Request method failure captured: Oct 19 00:39:55.579835 dv-cinder-master-3-smb devstack@n-api.service[125532]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 19 00:39:55.579835 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept: application/json Oct 19 00:39:55.579835 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept-Encoding: identity Oct 19 00:39:55.579835 dv-cinder-master-3-smb devstack@n-api.service[125532]: Connection: close Oct 19 00:39:55.579835 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Length: 119 Oct 19 00:39:55.579835 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Type: application/json Oct 19 00:39:55.579835 dv-cinder-master-3-smb devstack@n-api.service[125532]: Host: 10.222.0.33 Oct 19 00:39:55.579835 dv-cinder-master-3-smb devstack@n-api.service[125532]: Openstack-System-Scope: None Oct 19 00:39:55.579835 dv-cinder-master-3-smb devstack@n-api.service[125532]: User-Agent: python-urllib3/1.26.12 Oct 19 00:39:55.579835 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Auth-Token: gAAAAABjT0dYeFvQuaqEsw0ZiPj-Yb1-f-2xX_eGYpcOxdy5BlBASPb-qCF5BUrUbFqlocleRoRS-e2WSrarme2uGTasbmP0rqMgrdhE-yT0uVCYjV7T9M1sGJp4vGy5HdXv8WrbubDJ9u88RW46NfZpt1WpR1wowE9GWi1Z9lPeRbaehHwS12Q Oct 19 00:39:55.579835 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Id: None Oct 19 00:39:55.579835 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Name: None Oct 19 00:39:55.579835 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Identity-Status: Confirmed Oct 19 00:39:55.579835 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Is-Admin-Project: True Oct 19 00:39:55.579835 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Id: default Oct 19 00:39:55.579835 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Name: Default Oct 19 00:39:55.579835 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Id: caee808a710b4e52858ef4be7b1e555a Oct 19 00:39:55.579835 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Name: tempest-VolumesNegativeTest-403294352 Oct 19 00:39:55.579835 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Role: member,reader Oct 19 00:39:55.579835 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Roles: member,reader Oct 19 00:39:55.580982 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_caee808a710b4e52858ef4be7b1e555a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/caee808a710b4e52858ef4be7b1e555a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/caee808a710b4e52858ef4be7b1e555a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/caee808a710b4e52858ef4be7b1e555a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:39:55.580982 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant: tempest-VolumesNegativeTest-403294352 Oct 19 00:39:55.580982 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Id: caee808a710b4e52858ef4be7b1e555a Oct 19 00:39:55.580982 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Name: tempest-VolumesNegativeTest-403294352 Oct 19 00:39:55.580982 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User: tempest-VolumesNegativeTest-403294352-project Oct 19 00:39:55.580982 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Id: default Oct 19 00:39:55.580982 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Name: Default Oct 19 00:39:55.580982 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Id: 4c5ae97b5ab2408f9b60ec26d5d45856 Oct 19 00:39:55.580982 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Name: tempest-VolumesNegativeTest-403294352-project Oct 19 00:39:55.580982 dv-cinder-master-3-smb devstack@n-api.service[125532]: Oct 19 00:39:55.580982 dv-cinder-master-3-smb devstack@n-api.service[125532]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1296250347", "metadata": {"Type": "work"}}} Oct 19 00:39:55.580982 dv-cinder-master-3-smb devstack@n-api.service[125532]: method: Oct 19 00:39:55.580982 dv-cinder-master-3-smb devstack@n-api.service[125532]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 19 00:39:55.581739 dv-cinder-master-3-smb devstack@n-api.service[125532]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1296250347', 'metadata': {'Type': 'work'}}}} Oct 19 00:39:55.581739 dv-cinder-master-3-smb devstack@n-api.service[125532]: {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:39:55.581739 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:39:55.581739 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 00:39:55.581739 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 00:39:55.581739 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 00:39:55.581739 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise error Oct 19 00:39:55.581739 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 19 00:39:55.581739 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:39:55.581739 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 19 00:39:55.581739 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 19 00:39:55.581739 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:39:55.581739 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 19 00:39:55.581739 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi '' Oct 19 00:39:55.581739 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:39:55.581739 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:39:55.581739 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:39:55.581739 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:39:55.581739 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:39:55.581739 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:39:55.581739 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:39:55.581739 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:39:55.582850 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:39:55.582850 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:39:55.582850 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:39:55.582850 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:39:55.582850 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 00:39:55.582850 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 00:39:55.582850 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 00:39:55.582850 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 00:39:55.582850 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 00:39:55.582850 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 00:39:55.582850 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 19 00:39:55.582850 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:39:55.582850 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:39:55.582850 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:39:55.582850 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:39:55.582850 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:39:55.582850 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:39:55.582850 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 00:39:55.582850 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 00:39:55.583787 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 19 00:39:55.583787 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:39:55.583787 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-d82a7f7b-f51d-45a9-aca1-17e4c100f14a tempest-VolumesNegativeTest-403294352 tempest-VolumesNegativeTest-403294352-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=125532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:39:55.583787 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-d82a7f7b-f51d-45a9-aca1-17e4c100f14a tempest-VolumesNegativeTest-403294352 tempest-VolumesNegativeTest-403294352-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.024430 Oct 19 00:39:55.588155 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 10/19] 10.222.0.33 () {60 vars in 1156 bytes} [Wed Oct 19 00:39:55 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:39:55.702542 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-e99cd1de-e450-4474-8498-810f1eb68252 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Action: 'create', calling method: .version_select at 0x7f81f149a310>, body: {"keypair": {"name": "tempest-keypair-1917852036", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBID+wnSKrJ1+4UK+NoXtmAz8siRBKVWuTfvcBB8GBB82qz9uAul0j3YcU3LkUz1i9DCk7jApRpVlqTMynYcbX08PiaYTvtTITT0MS2m6Ws8b94tcjKsCHKoEFzJ2LbBsUA=="}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:39:55.791981 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.quota [None req-e99cd1de-e450-4474-8498-810f1eb68252 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Getting quotas for project f150d0c748e54c3eb4943b2b41adb99a. Resources: {'key_pairs'} {{(pid=125532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:39:55.803455 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.quota [None req-e99cd1de-e450-4474-8498-810f1eb68252 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Getting quotas for user aacade278860491a9eac6f86b9b2a319 and project f150d0c748e54c3eb4943b2b41adb99a. Resources: {'key_pairs'} {{(pid=125532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:39:55.925897 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-e99cd1de-e450-4474-8498-810f1eb68252 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.336262 Oct 19 00:39:55.927053 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 11/20] 10.222.0.33 () {60 vars in 1159 bytes} [Wed Oct 19 00:39:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:39:55.938957 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-0164e4d9-a1c2-4005-9b7c-a3495885d22a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:39:55.942373 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-0164e4d9-a1c2-4005-9b7c-a3495885d22a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:39:55.958524 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0164e4d9-a1c2-4005-9b7c-a3495885d22a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:39:55.960210 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0164e4d9-a1c2-4005-9b7c-a3495885d22a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:39:55.961795 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0164e4d9-a1c2-4005-9b7c-a3495885d22a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:39:55.963489 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0164e4d9-a1c2-4005-9b7c-a3495885d22a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:39:55.967717 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0164e4d9-a1c2-4005-9b7c-a3495885d22a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:39:55.973122 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0164e4d9-a1c2-4005-9b7c-a3495885d22a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:39:56.363100 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-0164e4d9-a1c2-4005-9b7c-a3495885d22a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda9dd9eb8d3446c96b0c702dd09d2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb46376a666496b896ad085315c58fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:39:56.379566 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-0164e4d9-a1c2-4005-9b7c-a3495885d22a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641" status: 200 len: 1219 microversion: 2.1 time: 0.451118 Oct 19 00:39:56.385885 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 12/21] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:39:55 2022] GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 => generated 1219 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:39:56.399454 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-62aa3695-2976-4648-9f98-ddf1488dc846 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:39:56.400381 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-62aa3695-2976-4648-9f98-ddf1488dc846 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:39:56.657834 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-62aa3695-2976-4648-9f98-ddf1488dc846 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:39:56.673505 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-62aa3695-2976-4648-9f98-ddf1488dc846 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:39:56.677386 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-62aa3695-2976-4648-9f98-ddf1488dc846 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:39:56.684901 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-62aa3695-2976-4648-9f98-ddf1488dc846 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1281 microversion: 2.20 time: 0.292816 Oct 19 00:39:56.705336 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 13/22] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:39:56 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1281 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:39:56.726872 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-9e0d9df1-a9af-4222-9d93-ecd0f6beae4a tempest-VolumesNegativeTest-403294352 tempest-VolumesNegativeTest-403294352-project] Calling method '.version_select at 0x7f81f1429f70>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:39:56.807283 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.wsgi [None req-9e0d9df1-a9af-4222-9d93-ecd0f6beae4a tempest-VolumesNegativeTest-403294352 tempest-VolumesNegativeTest-403294352-project] HTTP exception thrown: Volume tempest-invalid-1855460004 could not be found. Oct 19 00:39:56.812618 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-9e0d9df1-a9af-4222-9d93-ecd0f6beae4a tempest-VolumesNegativeTest-403294352 tempest-VolumesNegativeTest-403294352-project] Request method failure captured: Oct 19 00:39:56.812618 dv-cinder-master-3-smb devstack@n-api.service[125532]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1855460004 HTTP/1.1 Oct 19 00:39:56.812618 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept: application/json Oct 19 00:39:56.812618 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept-Encoding: identity Oct 19 00:39:56.812618 dv-cinder-master-3-smb devstack@n-api.service[125532]: Connection: close Oct 19 00:39:56.812618 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Length: 0 Oct 19 00:39:56.812618 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Type: application/json Oct 19 00:39:56.812618 dv-cinder-master-3-smb devstack@n-api.service[125532]: Host: 10.222.0.33 Oct 19 00:39:56.812618 dv-cinder-master-3-smb devstack@n-api.service[125532]: Openstack-System-Scope: None Oct 19 00:39:56.812618 dv-cinder-master-3-smb devstack@n-api.service[125532]: User-Agent: python-urllib3/1.26.12 Oct 19 00:39:56.812618 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Auth-Token: gAAAAABjT0dYeFvQuaqEsw0ZiPj-Yb1-f-2xX_eGYpcOxdy5BlBASPb-qCF5BUrUbFqlocleRoRS-e2WSrarme2uGTasbmP0rqMgrdhE-yT0uVCYjV7T9M1sGJp4vGy5HdXv8WrbubDJ9u88RW46NfZpt1WpR1wowE9GWi1Z9lPeRbaehHwS12Q Oct 19 00:39:56.812618 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Id: None Oct 19 00:39:56.812618 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Name: None Oct 19 00:39:56.812618 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Identity-Status: Confirmed Oct 19 00:39:56.812618 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Is-Admin-Project: True Oct 19 00:39:56.812618 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Id: default Oct 19 00:39:56.812618 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Name: Default Oct 19 00:39:56.812618 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Id: caee808a710b4e52858ef4be7b1e555a Oct 19 00:39:56.812618 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Name: tempest-VolumesNegativeTest-403294352 Oct 19 00:39:56.812618 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Role: member,reader Oct 19 00:39:56.812618 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Roles: member,reader Oct 19 00:39:56.814305 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_caee808a710b4e52858ef4be7b1e555a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/caee808a710b4e52858ef4be7b1e555a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/caee808a710b4e52858ef4be7b1e555a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/caee808a710b4e52858ef4be7b1e555a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:39:56.814305 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant: tempest-VolumesNegativeTest-403294352 Oct 19 00:39:56.814305 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Id: caee808a710b4e52858ef4be7b1e555a Oct 19 00:39:56.814305 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Name: tempest-VolumesNegativeTest-403294352 Oct 19 00:39:56.814305 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User: tempest-VolumesNegativeTest-403294352-project Oct 19 00:39:56.814305 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Id: default Oct 19 00:39:56.814305 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Name: Default Oct 19 00:39:56.814305 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Id: 4c5ae97b5ab2408f9b60ec26d5d45856 Oct 19 00:39:56.814305 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Name: tempest-VolumesNegativeTest-403294352-project Oct 19 00:39:56.814305 dv-cinder-master-3-smb devstack@n-api.service[125532]: method: Oct 19 00:39:56.814305 dv-cinder-master-3-smb devstack@n-api.service[125532]: exception: Volume tempest-invalid-1855460004 could not be found. Oct 19 00:39:56.814305 dv-cinder-master-3-smb devstack@n-api.service[125532]: action_args: {'id': 'tempest-invalid-1855460004'} Oct 19 00:39:56.814305 dv-cinder-master-3-smb devstack@n-api.service[125532]: {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:39:56.815005 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:39:56.815005 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 00:39:56.815005 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 00:39:56.815005 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 00:39:56.815005 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 00:39:56.815005 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 00:39:56.815005 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 00:39:56.815005 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 00:39:56.815005 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 00:39:56.815005 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 00:39:56.815005 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 00:39:56.815005 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 00:39:56.815005 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 00:39:56.815005 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 00:39:56.815005 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 00:39:56.815005 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1855460004 could not be found. (HTTP 404) (Request-ID: req-b0bf8b23-a2e3-44c8-9734-74e75edae0e9) Oct 19 00:39:56.815005 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:39:56.815005 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:39:56.815005 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:39:56.816358 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:39:56.816358 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 19 00:39:56.816358 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 19 00:39:56.816358 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 00:39:56.816358 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 00:39:56.816358 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 00:39:56.816358 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 00:39:56.816358 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 00:39:56.816358 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 00:39:56.816358 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 00:39:56.816358 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 00:39:56.816358 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 00:39:56.816358 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 00:39:56.816358 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 00:39:56.816358 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 00:39:56.816358 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 00:39:56.816358 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 00:39:56.816358 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 00:39:56.816358 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 00:39:56.817344 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 00:39:56.817344 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 00:39:56.817344 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 00:39:56.817344 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 00:39:56.817344 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1855460004 could not be found. Oct 19 00:39:56.817344 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:39:56.817344 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:39:56.817344 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:39:56.817344 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:39:56.817344 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:39:56.817344 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:39:56.817344 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:39:56.817344 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:39:56.817344 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:39:56.817344 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:39:56.817344 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:39:56.817344 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:39:56.817344 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 19 00:39:56.817344 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:39:56.817344 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1855460004 could not be found. Oct 19 00:39:56.818378 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:39:56.818378 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:39:56.818378 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:39:56.818378 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:39:56.818378 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:39:56.818378 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:39:56.818378 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:39:56.818378 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:39:56.818378 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1855460004 could not be found. Oct 19 00:39:56.818378 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:39:56.820122 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-9e0d9df1-a9af-4222-9d93-ecd0f6beae4a tempest-VolumesNegativeTest-403294352 tempest-VolumesNegativeTest-403294352-project] Returning 404 to user: Volume tempest-invalid-1855460004 could not be found. {{(pid=125532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:39:56.821231 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-9e0d9df1-a9af-4222-9d93-ecd0f6beae4a tempest-VolumesNegativeTest-403294352 tempest-VolumesNegativeTest-403294352-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1855460004" status: 404 len: 99 microversion: 2.1 time: 0.114405 Oct 19 00:39:56.822908 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 14/23] 10.222.0.33 () {58 vars in 1218 bytes} [Wed Oct 19 00:39:56 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1855460004 => generated 99 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:39:56.842257 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-f980626c-3acb-498f-95e3-d36df9668216 tempest-VolumesNegativeTest-403294352 tempest-VolumesNegativeTest-403294352-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009226 Oct 19 00:39:56.851915 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 15/24] 10.222.0.33 () {58 vars in 1140 bytes} [Wed Oct 19 00:39:56 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 19 00:39:56.867908 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-2026de54-d35b-490b-bc52-7a318631e030 tempest-VolumesNegativeTest-403294352 tempest-VolumesNegativeTest-403294352-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012428 Oct 19 00:39:56.875545 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 16/25] 10.222.0.33 () {58 vars in 1137 bytes} [Wed Oct 19 00:39:56 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 19 00:39:56.887395 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-085d18c2-ab2f-4180-8fee-6b784a347c08 tempest-VolumesNegativeTest-403294352 tempest-VolumesNegativeTest-403294352-project] Calling method '.version_select at 0x7f81f14e45e0>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:39:56.976061 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.wsgi [None req-085d18c2-ab2f-4180-8fee-6b784a347c08 tempest-VolumesNegativeTest-403294352 tempest-VolumesNegativeTest-403294352-project] HTTP exception thrown: Volume 0827c52d-cf9c-4912-ba31-bf792ac33154 could not be found. Oct 19 00:39:56.978832 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-085d18c2-ab2f-4180-8fee-6b784a347c08 tempest-VolumesNegativeTest-403294352 tempest-VolumesNegativeTest-403294352-project] Request method failure captured: Oct 19 00:39:56.978832 dv-cinder-master-3-smb devstack@n-api.service[125532]: request: DELETE /compute/v2.1/os-volumes/0827c52d-cf9c-4912-ba31-bf792ac33154 HTTP/1.1 Oct 19 00:39:56.978832 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept: application/json Oct 19 00:39:56.978832 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept-Encoding: identity Oct 19 00:39:56.978832 dv-cinder-master-3-smb devstack@n-api.service[125532]: Connection: close Oct 19 00:39:56.978832 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Length: 0 Oct 19 00:39:56.978832 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Type: application/json Oct 19 00:39:56.978832 dv-cinder-master-3-smb devstack@n-api.service[125532]: Host: 10.222.0.33 Oct 19 00:39:56.978832 dv-cinder-master-3-smb devstack@n-api.service[125532]: Openstack-System-Scope: None Oct 19 00:39:56.978832 dv-cinder-master-3-smb devstack@n-api.service[125532]: User-Agent: python-urllib3/1.26.12 Oct 19 00:39:56.978832 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Auth-Token: gAAAAABjT0dYeFvQuaqEsw0ZiPj-Yb1-f-2xX_eGYpcOxdy5BlBASPb-qCF5BUrUbFqlocleRoRS-e2WSrarme2uGTasbmP0rqMgrdhE-yT0uVCYjV7T9M1sGJp4vGy5HdXv8WrbubDJ9u88RW46NfZpt1WpR1wowE9GWi1Z9lPeRbaehHwS12Q Oct 19 00:39:56.978832 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Id: None Oct 19 00:39:56.978832 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Name: None Oct 19 00:39:56.978832 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Identity-Status: Confirmed Oct 19 00:39:56.978832 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Is-Admin-Project: True Oct 19 00:39:56.978832 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Id: default Oct 19 00:39:56.978832 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Name: Default Oct 19 00:39:56.978832 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Id: caee808a710b4e52858ef4be7b1e555a Oct 19 00:39:56.978832 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Name: tempest-VolumesNegativeTest-403294352 Oct 19 00:39:56.978832 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Role: member,reader Oct 19 00:39:56.978832 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Roles: member,reader Oct 19 00:39:56.980199 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_caee808a710b4e52858ef4be7b1e555a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/caee808a710b4e52858ef4be7b1e555a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/caee808a710b4e52858ef4be7b1e555a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/caee808a710b4e52858ef4be7b1e555a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:39:56.980199 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant: tempest-VolumesNegativeTest-403294352 Oct 19 00:39:56.980199 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Id: caee808a710b4e52858ef4be7b1e555a Oct 19 00:39:56.980199 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Name: tempest-VolumesNegativeTest-403294352 Oct 19 00:39:56.980199 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User: tempest-VolumesNegativeTest-403294352-project Oct 19 00:39:56.980199 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Id: default Oct 19 00:39:56.980199 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Name: Default Oct 19 00:39:56.980199 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Id: 4c5ae97b5ab2408f9b60ec26d5d45856 Oct 19 00:39:56.980199 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Name: tempest-VolumesNegativeTest-403294352-project Oct 19 00:39:56.980199 dv-cinder-master-3-smb devstack@n-api.service[125532]: method: Oct 19 00:39:56.980199 dv-cinder-master-3-smb devstack@n-api.service[125532]: exception: Volume 0827c52d-cf9c-4912-ba31-bf792ac33154 could not be found. Oct 19 00:39:56.980199 dv-cinder-master-3-smb devstack@n-api.service[125532]: action_args: {'id': '0827c52d-cf9c-4912-ba31-bf792ac33154'} Oct 19 00:39:56.980199 dv-cinder-master-3-smb devstack@n-api.service[125532]: {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:39:56.980990 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:39:56.980990 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 00:39:56.980990 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 00:39:56.980990 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 00:39:56.980990 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 00:39:56.980990 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 00:39:56.980990 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 00:39:56.980990 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 00:39:56.980990 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 00:39:56.980990 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 00:39:56.980990 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 00:39:56.980990 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 00:39:56.980990 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 00:39:56.980990 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 00:39:56.980990 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 00:39:56.980990 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0827c52d-cf9c-4912-ba31-bf792ac33154 could not be found. (HTTP 404) (Request-ID: req-82bd0fc7-30bd-4be8-b8a6-3f464691a307) Oct 19 00:39:56.980990 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:39:56.980990 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:39:56.980990 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:39:56.982175 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:39:56.982175 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 19 00:39:56.982175 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 19 00:39:56.982175 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 00:39:56.982175 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 00:39:56.982175 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 00:39:56.982175 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 00:39:56.982175 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 00:39:56.982175 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 00:39:56.982175 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 00:39:56.982175 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 00:39:56.982175 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 00:39:56.982175 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 00:39:56.982175 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 00:39:56.982175 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 00:39:56.982175 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 00:39:56.982175 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 00:39:56.982175 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 00:39:56.982175 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 00:39:56.983826 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 00:39:56.983826 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 00:39:56.983826 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 00:39:56.983826 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 00:39:56.983826 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0827c52d-cf9c-4912-ba31-bf792ac33154 could not be found. Oct 19 00:39:56.983826 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:39:56.983826 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:39:56.983826 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:39:56.983826 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:39:56.983826 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:39:56.983826 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:39:56.983826 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:39:56.983826 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:39:56.983826 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:39:56.983826 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:39:56.983826 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:39:56.983826 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:39:56.983826 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 19 00:39:56.983826 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:39:56.985149 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0827c52d-cf9c-4912-ba31-bf792ac33154 could not be found. Oct 19 00:39:56.985149 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:39:56.985149 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:39:56.985149 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:39:56.985149 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:39:56.985149 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:39:56.985149 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:39:56.985149 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:39:56.985149 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:39:56.985149 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0827c52d-cf9c-4912-ba31-bf792ac33154 could not be found. Oct 19 00:39:56.985149 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:39:56.986824 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-085d18c2-ab2f-4180-8fee-6b784a347c08 tempest-VolumesNegativeTest-403294352 tempest-VolumesNegativeTest-403294352-project] Returning 404 to user: Volume 0827c52d-cf9c-4912-ba31-bf792ac33154 could not be found. {{(pid=125532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:39:56.987835 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-085d18c2-ab2f-4180-8fee-6b784a347c08 tempest-VolumesNegativeTest-403294352 tempest-VolumesNegativeTest-403294352-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/0827c52d-cf9c-4912-ba31-bf792ac33154" status: 404 len: 109 microversion: 2.1 time: 0.110175 Oct 19 00:39:56.988706 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 17/26] 10.222.0.33 () {58 vars in 1248 bytes} [Wed Oct 19 00:39:56 2022] DELETE /compute/v2.1/os-volumes/0827c52d-cf9c-4912-ba31-bf792ac33154 => generated 109 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:39:57.007972 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-28626044-a58b-49a2-9bc6-0d16c2f4abc3 tempest-VolumesNegativeTest-403294352 tempest-VolumesNegativeTest-403294352-project] Calling method '.version_select at 0x7f81f1429a60>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:39:57.093724 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.wsgi [None req-28626044-a58b-49a2-9bc6-0d16c2f4abc3 tempest-VolumesNegativeTest-403294352 tempest-VolumesNegativeTest-403294352-project] HTTP exception thrown: Volume 46f2cc37-e6e3-42c3-8320-8bdb5da768cb could not be found. Oct 19 00:39:57.095696 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-28626044-a58b-49a2-9bc6-0d16c2f4abc3 tempest-VolumesNegativeTest-403294352 tempest-VolumesNegativeTest-403294352-project] Request method failure captured: Oct 19 00:39:57.095696 dv-cinder-master-3-smb devstack@n-api.service[125532]: request: GET /compute/v2.1/os-volumes/46f2cc37-e6e3-42c3-8320-8bdb5da768cb HTTP/1.1 Oct 19 00:39:57.095696 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept: application/json Oct 19 00:39:57.095696 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept-Encoding: identity Oct 19 00:39:57.095696 dv-cinder-master-3-smb devstack@n-api.service[125532]: Connection: close Oct 19 00:39:57.095696 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Length: 0 Oct 19 00:39:57.095696 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Type: application/json Oct 19 00:39:57.095696 dv-cinder-master-3-smb devstack@n-api.service[125532]: Host: 10.222.0.33 Oct 19 00:39:57.095696 dv-cinder-master-3-smb devstack@n-api.service[125532]: Openstack-System-Scope: None Oct 19 00:39:57.095696 dv-cinder-master-3-smb devstack@n-api.service[125532]: User-Agent: python-urllib3/1.26.12 Oct 19 00:39:57.095696 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Auth-Token: gAAAAABjT0dYeFvQuaqEsw0ZiPj-Yb1-f-2xX_eGYpcOxdy5BlBASPb-qCF5BUrUbFqlocleRoRS-e2WSrarme2uGTasbmP0rqMgrdhE-yT0uVCYjV7T9M1sGJp4vGy5HdXv8WrbubDJ9u88RW46NfZpt1WpR1wowE9GWi1Z9lPeRbaehHwS12Q Oct 19 00:39:57.095696 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Id: None Oct 19 00:39:57.095696 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Name: None Oct 19 00:39:57.095696 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Identity-Status: Confirmed Oct 19 00:39:57.095696 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Is-Admin-Project: True Oct 19 00:39:57.095696 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Id: default Oct 19 00:39:57.095696 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Name: Default Oct 19 00:39:57.095696 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Id: caee808a710b4e52858ef4be7b1e555a Oct 19 00:39:57.095696 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Name: tempest-VolumesNegativeTest-403294352 Oct 19 00:39:57.095696 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Role: member,reader Oct 19 00:39:57.095696 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Roles: member,reader Oct 19 00:39:57.096974 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_caee808a710b4e52858ef4be7b1e555a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/caee808a710b4e52858ef4be7b1e555a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/caee808a710b4e52858ef4be7b1e555a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/caee808a710b4e52858ef4be7b1e555a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:39:57.096974 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant: tempest-VolumesNegativeTest-403294352 Oct 19 00:39:57.096974 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Id: caee808a710b4e52858ef4be7b1e555a Oct 19 00:39:57.096974 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Name: tempest-VolumesNegativeTest-403294352 Oct 19 00:39:57.096974 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User: tempest-VolumesNegativeTest-403294352-project Oct 19 00:39:57.096974 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Id: default Oct 19 00:39:57.096974 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Name: Default Oct 19 00:39:57.096974 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Id: 4c5ae97b5ab2408f9b60ec26d5d45856 Oct 19 00:39:57.096974 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Name: tempest-VolumesNegativeTest-403294352-project Oct 19 00:39:57.096974 dv-cinder-master-3-smb devstack@n-api.service[125532]: method: Oct 19 00:39:57.096974 dv-cinder-master-3-smb devstack@n-api.service[125532]: exception: Volume 46f2cc37-e6e3-42c3-8320-8bdb5da768cb could not be found. Oct 19 00:39:57.096974 dv-cinder-master-3-smb devstack@n-api.service[125532]: action_args: {'id': '46f2cc37-e6e3-42c3-8320-8bdb5da768cb'} Oct 19 00:39:57.096974 dv-cinder-master-3-smb devstack@n-api.service[125532]: {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:39:57.097770 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:39:57.097770 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 00:39:57.097770 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 00:39:57.097770 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 00:39:57.097770 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 00:39:57.097770 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 00:39:57.097770 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 00:39:57.097770 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 00:39:57.097770 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 00:39:57.097770 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 00:39:57.097770 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 00:39:57.097770 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 00:39:57.097770 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 00:39:57.097770 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 00:39:57.097770 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 00:39:57.097770 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 46f2cc37-e6e3-42c3-8320-8bdb5da768cb could not be found. (HTTP 404) (Request-ID: req-c4f4f046-71c6-450d-809a-a00ca1980860) Oct 19 00:39:57.097770 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:39:57.097770 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:39:57.097770 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:39:57.098811 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:39:57.098811 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 19 00:39:57.098811 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 19 00:39:57.098811 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 00:39:57.098811 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 00:39:57.098811 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 00:39:57.098811 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 00:39:57.098811 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 00:39:57.098811 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 00:39:57.098811 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 00:39:57.098811 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 00:39:57.098811 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 00:39:57.098811 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 00:39:57.098811 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 00:39:57.098811 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 00:39:57.098811 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 00:39:57.098811 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 00:39:57.098811 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 00:39:57.098811 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 00:39:57.099690 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 00:39:57.099690 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 00:39:57.099690 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 00:39:57.099690 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 00:39:57.099690 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 46f2cc37-e6e3-42c3-8320-8bdb5da768cb could not be found. Oct 19 00:39:57.099690 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:39:57.099690 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:39:57.099690 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:39:57.099690 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:39:57.099690 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:39:57.099690 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:39:57.099690 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:39:57.099690 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:39:57.099690 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:39:57.099690 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:39:57.099690 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:39:57.099690 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:39:57.099690 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 19 00:39:57.099690 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:39:57.100756 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 46f2cc37-e6e3-42c3-8320-8bdb5da768cb could not be found. Oct 19 00:39:57.100756 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:39:57.100756 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:39:57.100756 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:39:57.100756 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:39:57.100756 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:39:57.100756 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:39:57.100756 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:39:57.100756 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:39:57.100756 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 46f2cc37-e6e3-42c3-8320-8bdb5da768cb could not be found. Oct 19 00:39:57.100756 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:39:57.100756 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-28626044-a58b-49a2-9bc6-0d16c2f4abc3 tempest-VolumesNegativeTest-403294352 tempest-VolumesNegativeTest-403294352-project] Returning 404 to user: Volume 46f2cc37-e6e3-42c3-8320-8bdb5da768cb could not be found. {{(pid=125532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:39:57.100756 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-28626044-a58b-49a2-9bc6-0d16c2f4abc3 tempest-VolumesNegativeTest-403294352 tempest-VolumesNegativeTest-403294352-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/46f2cc37-e6e3-42c3-8320-8bdb5da768cb" status: 404 len: 109 microversion: 2.1 time: 0.103785 Oct 19 00:39:57.114206 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 18/27] 10.222.0.33 () {58 vars in 1245 bytes} [Wed Oct 19 00:39:56 2022] GET /compute/v2.1/os-volumes/46f2cc37-e6e3-42c3-8320-8bdb5da768cb => generated 109 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:39:57.410223 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-0c9e7eac-9ee6-410c-8d08-15d2d50484b2 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:39:57.410864 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-0c9e7eac-9ee6-410c-8d08-15d2d50484b2 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:39:57.426623 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0c9e7eac-9ee6-410c-8d08-15d2d50484b2 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:39:57.428374 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0c9e7eac-9ee6-410c-8d08-15d2d50484b2 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:39:57.430076 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0c9e7eac-9ee6-410c-8d08-15d2d50484b2 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:39:57.433351 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0c9e7eac-9ee6-410c-8d08-15d2d50484b2 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:39:57.438314 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0c9e7eac-9ee6-410c-8d08-15d2d50484b2 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:39:57.439567 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0c9e7eac-9ee6-410c-8d08-15d2d50484b2 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:39:57.737660 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-32b0025e-30c2-4495-9b8d-02c54ebb4bb2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Flavor limits 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:39:57.738172 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-32b0025e-30c2-4495-9b8d-02c54ebb4bb2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Image limits 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:39:57.738729 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-32b0025e-30c2-4495-9b8d-02c54ebb4bb2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Flavor pref 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:39:57.739142 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-32b0025e-30c2-4495-9b8d-02c54ebb4bb2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Image pref 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:39:57.739609 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-32b0025e-30c2-4495-9b8d-02c54ebb4bb2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:39:57.773881 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-32b0025e-30c2-4495-9b8d-02c54ebb4bb2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:39:57.774365 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-32b0025e-30c2-4495-9b8d-02c54ebb4bb2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:39:57.778675 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-32b0025e-30c2-4495-9b8d-02c54ebb4bb2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:39:57.782923 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-32b0025e-30c2-4495-9b8d-02c54ebb4bb2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:39:57.783533 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-32b0025e-30c2-4495-9b8d-02c54ebb4bb2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:39:57.784419 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-32b0025e-30c2-4495-9b8d-02c54ebb4bb2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:39:57.859766 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.quota [None req-32b0025e-30c2-4495-9b8d-02c54ebb4bb2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Getting quotas for project 5a230211180742ef9efd4d62b630d211. Resources: {'instances', 'cores', 'ram'} {{(pid=125531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:39:57.873901 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.quota [None req-32b0025e-30c2-4495-9b8d-02c54ebb4bb2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Getting quotas for user 5628a861c90042d88b95f2d7b898ed52 and project 5a230211180742ef9efd4d62b630d211. Resources: {'instances', 'cores', 'ram'} {{(pid=125531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:39:57.909632 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-32b0025e-30c2-4495-9b8d-02c54ebb4bb2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Going to run 1 instances... {{(pid=125531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:39:57.918764 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-32b0025e-30c2-4495-9b8d-02c54ebb4bb2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4389c416-28bf-4b8e-945e-386f38c16859] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1f4abc9-3bb9-4343-9a05-53d758070c9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:39:58.239996 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-32b0025e-30c2-4495-9b8d-02c54ebb4bb2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.534366 Oct 19 00:39:58.242532 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 10/28] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Oct 19 00:39:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 3539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:39:58.266287 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-d96a88b4-dbb5-4f2a-80b4-85f2a42ddc80 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:39:58.267081 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-d96a88b4-dbb5-4f2a-80b4-85f2a42ddc80 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:39:58.309315 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d96a88b4-dbb5-4f2a-80b4-85f2a42ddc80 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:39:58.309815 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d96a88b4-dbb5-4f2a-80b4-85f2a42ddc80 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:39:58.310258 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d96a88b4-dbb5-4f2a-80b4-85f2a42ddc80 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:39:58.311678 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d96a88b4-dbb5-4f2a-80b4-85f2a42ddc80 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:39:58.345722 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d96a88b4-dbb5-4f2a-80b4-85f2a42ddc80 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:39:58.346945 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d96a88b4-dbb5-4f2a-80b4-85f2a42ddc80 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:39:58.347218 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-0c9e7eac-9ee6-410c-8d08-15d2d50484b2 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda9dd9eb8d3446c96b0c702dd09d2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb46376a666496b896ad085315c58fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:39:58.376289 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-0c9e7eac-9ee6-410c-8d08-15d2d50484b2 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641" status: 200 len: 1267 microversion: 2.1 time: 0.968642 Oct 19 00:39:58.379495 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 19/29] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:39:57 2022] GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 => generated 1267 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:39:58.393580 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-95b72414-456b-4ee5-86b3-d6cac2e80818 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:39:58.394857 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-95b72414-456b-4ee5-86b3-d6cac2e80818 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4389c416-28bf-4b8e-945e-386f38c16859] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:39:58.961403 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-95b72414-456b-4ee5-86b3-d6cac2e80818 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:39:58.972362 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-95b72414-456b-4ee5-86b3-d6cac2e80818 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859" status: 200 len: 1222 microversion: 2.1 time: 0.591495 Oct 19 00:39:58.973872 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 20/30] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:39:58 2022] GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859 => generated 1222 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:39:59.219811 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-d96a88b4-dbb5-4f2a-80b4-85f2a42ddc80 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:39:59.282003 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-d96a88b4-dbb5-4f2a-80b4-85f2a42ddc80 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:39:59.291044 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-d96a88b4-dbb5-4f2a-80b4-85f2a42ddc80 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:39:59.298862 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-d96a88b4-dbb5-4f2a-80b4-85f2a42ddc80 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1333 microversion: 2.20 time: 1.050732 Oct 19 00:39:59.299494 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 11/31] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:39:58 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1333 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:39:59.408203 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-63f8505a-d3e0-4fcb-a0ca-13ca612e6e43 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:39:59.409046 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-63f8505a-d3e0-4fcb-a0ca-13ca612e6e43 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:39:59.425042 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-63f8505a-d3e0-4fcb-a0ca-13ca612e6e43 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:39:59.425627 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-63f8505a-d3e0-4fcb-a0ca-13ca612e6e43 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:39:59.429457 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-63f8505a-d3e0-4fcb-a0ca-13ca612e6e43 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:39:59.430288 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-63f8505a-d3e0-4fcb-a0ca-13ca612e6e43 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:39:59.430770 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-63f8505a-d3e0-4fcb-a0ca-13ca612e6e43 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:39:59.434802 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-63f8505a-d3e0-4fcb-a0ca-13ca612e6e43 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:39:59.490520 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-96db23aa-dd28-4705-9b61-66f5c17dade3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-337469343", "imageRef": "d1f4abc9-3bb9-4343-9a05-53d758070c9d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:39:59.638279 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.network.neutron [None req-96db23aa-dd28-4705-9b61-66f5c17dade3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] validate_networks() for [('ea4fbcd4-f89f-4128-8b67-a27e8fce8a1a', None, None, None, None, None)] {{(pid=125531) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:40:00.365791 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-63f8505a-d3e0-4fcb-a0ca-13ca612e6e43 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda9dd9eb8d3446c96b0c702dd09d2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb46376a666496b896ad085315c58fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:00.382855 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-63f8505a-d3e0-4fcb-a0ca-13ca612e6e43 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641" status: 200 len: 1273 microversion: 2.1 time: 0.978367 Oct 19 00:40:00.390117 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 21/32] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:39:59 2022] GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 => generated 1273 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:00.414033 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-27969c21-324f-437f-90c1-a32686ea330d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:00.417283 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-27969c21-324f-437f-90c1-a32686ea330d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:00.445480 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-27969c21-324f-437f-90c1-a32686ea330d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:00.447292 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-27969c21-324f-437f-90c1-a32686ea330d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:00.451004 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-27969c21-324f-437f-90c1-a32686ea330d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:00.455784 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-27969c21-324f-437f-90c1-a32686ea330d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:00.457292 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-27969c21-324f-437f-90c1-a32686ea330d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:00.459496 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-27969c21-324f-437f-90c1-a32686ea330d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:01.190369 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-27969c21-324f-437f-90c1-a32686ea330d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:01.233147 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-27969c21-324f-437f-90c1-a32686ea330d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:01.237589 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-27969c21-324f-437f-90c1-a32686ea330d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:01.244203 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-27969c21-324f-437f-90c1-a32686ea330d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1339 microversion: 2.20 time: 0.851392 Oct 19 00:40:01.244829 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 22/33] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:40:00 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1339 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:40:01.415512 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-4f07d41b-661a-4c0b-b108-9fc689ef2bf8 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:01.416274 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-4f07d41b-661a-4c0b-b108-9fc689ef2bf8 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:01.434106 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4f07d41b-661a-4c0b-b108-9fc689ef2bf8 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:01.437389 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4f07d41b-661a-4c0b-b108-9fc689ef2bf8 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:01.440140 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4f07d41b-661a-4c0b-b108-9fc689ef2bf8 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:01.442886 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4f07d41b-661a-4c0b-b108-9fc689ef2bf8 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:01.445386 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4f07d41b-661a-4c0b-b108-9fc689ef2bf8 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:01.448670 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4f07d41b-661a-4c0b-b108-9fc689ef2bf8 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:03.176888 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-4f07d41b-661a-4c0b-b108-9fc689ef2bf8 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda9dd9eb8d3446c96b0c702dd09d2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb46376a666496b896ad085315c58fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:03.191107 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-96db23aa-dd28-4705-9b61-66f5c17dade3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Flavor limits 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:40:03.192946 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-96db23aa-dd28-4705-9b61-66f5c17dade3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Image limits 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:40:03.193785 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-96db23aa-dd28-4705-9b61-66f5c17dade3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Flavor pref 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:40:03.194613 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-96db23aa-dd28-4705-9b61-66f5c17dade3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Image pref 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:40:03.195343 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-96db23aa-dd28-4705-9b61-66f5c17dade3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:40:03.206721 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-4f07d41b-661a-4c0b-b108-9fc689ef2bf8 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641" status: 200 len: 1315 microversion: 2.1 time: 1.778660 Oct 19 00:40:03.207408 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 23/34] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:01 2022] GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 => generated 1315 bytes in 1797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:40:03.215818 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-96db23aa-dd28-4705-9b61-66f5c17dade3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:03.223232 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-96db23aa-dd28-4705-9b61-66f5c17dade3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:03.223232 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-96db23aa-dd28-4705-9b61-66f5c17dade3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:03.223232 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-96db23aa-dd28-4705-9b61-66f5c17dade3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:03.223232 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-96db23aa-dd28-4705-9b61-66f5c17dade3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:03.223574 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-96db23aa-dd28-4705-9b61-66f5c17dade3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:03.234846 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-ebffad43-8c6b-4142-890a-f60e18530331 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:03.261960 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-ebffad43-8c6b-4142-890a-f60e18530331 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:03.278262 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.quota [None req-96db23aa-dd28-4705-9b61-66f5c17dade3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Getting quotas for project 5a230211180742ef9efd4d62b630d211. Resources: {'instances', 'cores', 'ram'} {{(pid=125531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:40:03.287912 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ebffad43-8c6b-4142-890a-f60e18530331 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:03.290949 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.quota [None req-96db23aa-dd28-4705-9b61-66f5c17dade3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Getting quotas for user 5628a861c90042d88b95f2d7b898ed52 and project 5a230211180742ef9efd4d62b630d211. Resources: {'instances', 'cores', 'ram'} {{(pid=125531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:40:03.293136 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ebffad43-8c6b-4142-890a-f60e18530331 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:03.296144 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ebffad43-8c6b-4142-890a-f60e18530331 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:03.301101 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ebffad43-8c6b-4142-890a-f60e18530331 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:03.308400 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ebffad43-8c6b-4142-890a-f60e18530331 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:03.314983 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ebffad43-8c6b-4142-890a-f60e18530331 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:03.334257 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-96db23aa-dd28-4705-9b61-66f5c17dade3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Going to run 1 instances... {{(pid=125531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:40:03.336834 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-96db23aa-dd28-4705-9b61-66f5c17dade3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1f4abc9-3bb9-4343-9a05-53d758070c9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:40:03.502857 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-96db23aa-dd28-4705-9b61-66f5c17dade3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.024255 Oct 19 00:40:03.511503 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 12/35] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Oct 19 00:39:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 4034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 00:40:03.532903 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-3a831131-1957-427f-b92f-ac8ec3e13baa tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:03.556618 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-3a831131-1957-427f-b92f-ac8ec3e13baa tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:03.964884 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-3a831131-1957-427f-b92f-ac8ec3e13baa tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:04.002479 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-3a831131-1957-427f-b92f-ac8ec3e13baa tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1221 microversion: 2.1 time: 0.481938 Oct 19 00:40:04.006174 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 13/36] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:03 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1221 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:04.240919 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-0c8e85c3-05c4-4a2b-b191-4738248974c8 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:04.241577 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-0c8e85c3-05c4-4a2b-b191-4738248974c8 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:04.258839 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0c8e85c3-05c4-4a2b-b191-4738248974c8 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:04.259325 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-ebffad43-8c6b-4142-890a-f60e18530331 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:04.267329 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0c8e85c3-05c4-4a2b-b191-4738248974c8 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:04.269925 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-ebffad43-8c6b-4142-890a-f60e18530331 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:04.270755 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0c8e85c3-05c4-4a2b-b191-4738248974c8 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:04.271448 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-ebffad43-8c6b-4142-890a-f60e18530331 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:04.274617 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0c8e85c3-05c4-4a2b-b191-4738248974c8 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:04.275399 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0c8e85c3-05c4-4a2b-b191-4738248974c8 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:04.275689 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0c8e85c3-05c4-4a2b-b191-4738248974c8 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:04.285743 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-ebffad43-8c6b-4142-890a-f60e18530331 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1339 microversion: 2.20 time: 1.077123 Oct 19 00:40:04.293079 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 24/37] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:40:03 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1339 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:40:04.853185 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-0f606a95-e572-4530-b9c0-895bb08f0136 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-938669460", "imageRef": "d1f4abc9-3bb9-4343-9a05-53d758070c9d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e4e49b3c-1347-4eda-9be1-f1139c6e3c46"}], "security_groups": [{"name": "tempest-securitygroup--2139464073"}], "key_name": "tempest-keypair-998982525", "user_data": "}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:40:05.330299 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell0:SELECT=4 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:05.759468 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.network.neutron [None req-0f606a95-e572-4530-b9c0-895bb08f0136 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] validate_networks() for [('e4e49b3c-1347-4eda-9be1-f1139c6e3c46', None, None, None, None, None)] {{(pid=125532) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:40:06.717480 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-0c8e85c3-05c4-4a2b-b191-4738248974c8 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda9dd9eb8d3446c96b0c702dd09d2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb46376a666496b896ad085315c58fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:06.730926 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-0c8e85c3-05c4-4a2b-b191-4738248974c8 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641" status: 200 len: 1315 microversion: 2.1 time: 2.496547 Oct 19 00:40:06.747903 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 14/38] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:04 2022] GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 => generated 1315 bytes in 2505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:06.764753 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-c1e0aea6-e67a-4df7-b718-c54932c38b55 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:06.765506 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-c1e0aea6-e67a-4df7-b718-c54932c38b55 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:06.791657 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c1e0aea6-e67a-4df7-b718-c54932c38b55 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:06.795785 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c1e0aea6-e67a-4df7-b718-c54932c38b55 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:06.796307 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c1e0aea6-e67a-4df7-b718-c54932c38b55 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:06.800750 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c1e0aea6-e67a-4df7-b718-c54932c38b55 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:06.802450 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c1e0aea6-e67a-4df7-b718-c54932c38b55 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:06.803588 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c1e0aea6-e67a-4df7-b718-c54932c38b55 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:08.362989 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-c1e0aea6-e67a-4df7-b718-c54932c38b55 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:08.373832 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-c1e0aea6-e67a-4df7-b718-c54932c38b55 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1279 microversion: 2.1 time: 1.636272 Oct 19 00:40:08.375318 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 15/39] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:06 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1279 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:08.385840 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-182b551c-bba9-4b8c-aec0-7a0f05b3e9d1 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:08.392880 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-182b551c-bba9-4b8c-aec0-7a0f05b3e9d1 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:08.422862 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-182b551c-bba9-4b8c-aec0-7a0f05b3e9d1 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:08.424831 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-182b551c-bba9-4b8c-aec0-7a0f05b3e9d1 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:08.426072 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-182b551c-bba9-4b8c-aec0-7a0f05b3e9d1 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:08.427605 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-182b551c-bba9-4b8c-aec0-7a0f05b3e9d1 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:08.434925 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-182b551c-bba9-4b8c-aec0-7a0f05b3e9d1 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:08.435530 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-182b551c-bba9-4b8c-aec0-7a0f05b3e9d1 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:08.967467 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell0:SELECT=22 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:09.153578 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-0f606a95-e572-4530-b9c0-895bb08f0136 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Flavor limits 0:0:0 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:40:09.154627 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-0f606a95-e572-4530-b9c0-895bb08f0136 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Image limits 0:0:0 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:40:09.155331 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-0f606a95-e572-4530-b9c0-895bb08f0136 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Flavor pref 0:0:0 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:40:09.156022 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-0f606a95-e572-4530-b9c0-895bb08f0136 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Image pref 0:0:0 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:40:09.156461 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-0f606a95-e572-4530-b9c0-895bb08f0136 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:40:09.175576 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0f606a95-e572-4530-b9c0-895bb08f0136 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:09.179398 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0f606a95-e572-4530-b9c0-895bb08f0136 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:09.180097 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0f606a95-e572-4530-b9c0-895bb08f0136 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:09.184113 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0f606a95-e572-4530-b9c0-895bb08f0136 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:09.188063 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0f606a95-e572-4530-b9c0-895bb08f0136 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:09.193107 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0f606a95-e572-4530-b9c0-895bb08f0136 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:09.262632 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.quota [None req-0f606a95-e572-4530-b9c0-895bb08f0136 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Getting quotas for project 4081d4f735b04367a67a03b9539f5432. Resources: {'instances', 'cores', 'ram'} {{(pid=125532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:40:09.276210 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.quota [None req-0f606a95-e572-4530-b9c0-895bb08f0136 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Getting quotas for user 5f9a55c605f04f478d0a71679d8bf6a1 and project 4081d4f735b04367a67a03b9539f5432. Resources: {'instances', 'cores', 'ram'} {{(pid=125532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:40:09.322695 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-0f606a95-e572-4530-b9c0-895bb08f0136 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Going to run 1 instances... {{(pid=125532) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:40:09.330017 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-0f606a95-e572-4530-b9c0-895bb08f0136 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 361dfd3b-f488-4dac-9511-f28c93f74d37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1f4abc9-3bb9-4343-9a05-53d758070c9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125532) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:40:09.486064 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-0f606a95-e572-4530-b9c0-895bb08f0136 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.637437 Oct 19 00:40:09.491101 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-182b551c-bba9-4b8c-aec0-7a0f05b3e9d1 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:09.495645 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 25/40] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Oct 19 00:40:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 4648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:40:09.508460 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-d0e4f3f4-ff95-4631-b0df-1bcd8c731bc8 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:09.509088 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-d0e4f3f4-ff95-4631-b0df-1bcd8c731bc8 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:09.530467 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d0e4f3f4-ff95-4631-b0df-1bcd8c731bc8 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:09.531257 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-182b551c-bba9-4b8c-aec0-7a0f05b3e9d1 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:09.534865 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-182b551c-bba9-4b8c-aec0-7a0f05b3e9d1 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:09.538030 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d0e4f3f4-ff95-4631-b0df-1bcd8c731bc8 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:09.542984 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-182b551c-bba9-4b8c-aec0-7a0f05b3e9d1 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1407 microversion: 2.20 time: 1.163773 Oct 19 00:40:09.547269 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d0e4f3f4-ff95-4631-b0df-1bcd8c731bc8 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:09.548258 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d0e4f3f4-ff95-4631-b0df-1bcd8c731bc8 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:09.550424 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d0e4f3f4-ff95-4631-b0df-1bcd8c731bc8 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:09.553062 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d0e4f3f4-ff95-4631-b0df-1bcd8c731bc8 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:09.578894 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 16/41] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:40:08 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1407 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:40:09.642640 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-99ce48d5-d6ba-4621-8150-80147546ca80 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:09.646410 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-99ce48d5-d6ba-4621-8150-80147546ca80 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:09.694602 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-99ce48d5-d6ba-4621-8150-80147546ca80 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:09.695367 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-99ce48d5-d6ba-4621-8150-80147546ca80 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:09.697305 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-99ce48d5-d6ba-4621-8150-80147546ca80 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:09.699770 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-99ce48d5-d6ba-4621-8150-80147546ca80 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:09.700431 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-99ce48d5-d6ba-4621-8150-80147546ca80 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:09.700882 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-99ce48d5-d6ba-4621-8150-80147546ca80 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:10.063789 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-99ce48d5-d6ba-4621-8150-80147546ca80 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:10.079099 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-99ce48d5-d6ba-4621-8150-80147546ca80 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1279 microversion: 2.1 time: 0.495649 Oct 19 00:40:10.096635 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 17/42] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:09 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1279 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:10.116325 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-09d9b6d8-8e15-4cc8-a321-9502b01f419f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2066540675", "imageRef": "d1f4abc9-3bb9-4343-9a05-53d758070c9d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ee4d8b37-3c72-450e-867b-ee9fb1ac3254"}], "security_groups": [{"name": "tempest-securitygroup--1149175088"}], "key_name": "tempest-keypair-1917852036", "user_data": "}} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:40:10.941927 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-d0e4f3f4-ff95-4631-b0df-1bcd8c731bc8 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda9dd9eb8d3446c96b0c702dd09d2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb46376a666496b896ad085315c58fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:10.956287 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-d0e4f3f4-ff95-4631-b0df-1bcd8c731bc8 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641" status: 200 len: 1315 microversion: 2.1 time: 1.453912 Oct 19 00:40:10.957118 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 26/43] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:09 2022] GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 => generated 1315 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:10.966097 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-ba9b06f0-d9de-4e19-9dd9-de280938c3a2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:10.968956 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-ba9b06f0-d9de-4e19-9dd9-de280938c3a2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 361dfd3b-f488-4dac-9511-f28c93f74d37] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:10.986689 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ba9b06f0-d9de-4e19-9dd9-de280938c3a2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:10.987571 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ba9b06f0-d9de-4e19-9dd9-de280938c3a2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:10.988304 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ba9b06f0-d9de-4e19-9dd9-de280938c3a2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:10.989336 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ba9b06f0-d9de-4e19-9dd9-de280938c3a2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:10.991737 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ba9b06f0-d9de-4e19-9dd9-de280938c3a2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:10.994296 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ba9b06f0-d9de-4e19-9dd9-de280938c3a2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:11.083523 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.network.neutron [None req-09d9b6d8-8e15-4cc8-a321-9502b01f419f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] validate_networks() for [('ee4d8b37-3c72-450e-867b-ee9fb1ac3254', None, None, None, None, None)] {{(pid=125531) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:40:11.240006 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-ba9b06f0-d9de-4e19-9dd9-de280938c3a2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:11.260283 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-ba9b06f0-d9de-4e19-9dd9-de280938c3a2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37" status: 200 len: 1244 microversion: 2.1 time: 0.301440 Oct 19 00:40:11.263773 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 27/44] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:10 2022] GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37 => generated 1244 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:11.286129 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-88a24461-a3a8-4404-846f-23ed84737329 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:11.290612 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-88a24461-a3a8-4404-846f-23ed84737329 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:11.304427 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-88a24461-a3a8-4404-846f-23ed84737329 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:11.304932 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-88a24461-a3a8-4404-846f-23ed84737329 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:11.308757 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-88a24461-a3a8-4404-846f-23ed84737329 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:11.309519 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-88a24461-a3a8-4404-846f-23ed84737329 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:11.309998 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-88a24461-a3a8-4404-846f-23ed84737329 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:11.312186 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-88a24461-a3a8-4404-846f-23ed84737329 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:12.734495 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-09d9b6d8-8e15-4cc8-a321-9502b01f419f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Flavor limits 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:40:12.735150 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-09d9b6d8-8e15-4cc8-a321-9502b01f419f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Image limits 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:40:12.735515 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-09d9b6d8-8e15-4cc8-a321-9502b01f419f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Flavor pref 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:40:12.735958 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-09d9b6d8-8e15-4cc8-a321-9502b01f419f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Image pref 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:40:12.736512 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-09d9b6d8-8e15-4cc8-a321-9502b01f419f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:40:12.756693 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-09d9b6d8-8e15-4cc8-a321-9502b01f419f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:12.758674 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-09d9b6d8-8e15-4cc8-a321-9502b01f419f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:12.759842 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-09d9b6d8-8e15-4cc8-a321-9502b01f419f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:12.761224 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-09d9b6d8-8e15-4cc8-a321-9502b01f419f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:12.761708 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-09d9b6d8-8e15-4cc8-a321-9502b01f419f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:12.763966 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-09d9b6d8-8e15-4cc8-a321-9502b01f419f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:12.825283 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.quota [None req-09d9b6d8-8e15-4cc8-a321-9502b01f419f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Getting quotas for project f150d0c748e54c3eb4943b2b41adb99a. Resources: {'instances', 'cores', 'ram'} {{(pid=125531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:40:12.833178 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.quota [None req-09d9b6d8-8e15-4cc8-a321-9502b01f419f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Getting quotas for user aacade278860491a9eac6f86b9b2a319 and project f150d0c748e54c3eb4943b2b41adb99a. Resources: {'instances', 'cores', 'ram'} {{(pid=125531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:40:12.860739 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-09d9b6d8-8e15-4cc8-a321-9502b01f419f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Going to run 1 instances... {{(pid=125531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:40:12.870063 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-09d9b6d8-8e15-4cc8-a321-9502b01f419f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1f4abc9-3bb9-4343-9a05-53d758070c9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:40:13.045890 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-88a24461-a3a8-4404-846f-23ed84737329 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:13.064032 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-88a24461-a3a8-4404-846f-23ed84737329 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:13.081243 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-88a24461-a3a8-4404-846f-23ed84737329 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:13.083063 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-88a24461-a3a8-4404-846f-23ed84737329 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1407 microversion: 2.20 time: 1.817043 Oct 19 00:40:13.083697 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 28/45] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:40:11 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1407 bytes in 1819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:40:13.117223 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-09d9b6d8-8e15-4cc8-a321-9502b01f419f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.019130 Oct 19 00:40:13.120564 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-edeb5c61-a7a1-40e8-9c54-c5dc48772b05 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:13.121528 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 18/46] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Oct 19 00:40:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 3024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:40:13.124373 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-edeb5c61-a7a1-40e8-9c54-c5dc48772b05 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:13.153701 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-edeb5c61-a7a1-40e8-9c54-c5dc48772b05 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:13.155211 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-edeb5c61-a7a1-40e8-9c54-c5dc48772b05 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:13.155458 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-edeb5c61-a7a1-40e8-9c54-c5dc48772b05 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:13.159486 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-edeb5c61-a7a1-40e8-9c54-c5dc48772b05 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:13.160252 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-edeb5c61-a7a1-40e8-9c54-c5dc48772b05 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:13.160710 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-edeb5c61-a7a1-40e8-9c54-c5dc48772b05 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:13.720577 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-53c32045-f890-4964-a651-6eb23b279f6c req-ee60d794-9e3a-40d0-9b2f-b160b6ae155e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b669ea21-79c9-4f4c-aa6b-e6c0cec96641", "tag": "c18fbf98-f795-40c5-946a-d03e103edc85"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:40:13.795656 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-53c32045-f890-4964-a651-6eb23b279f6c req-ee60d794-9e3a-40d0-9b2f-b160b6ae155e service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:13.796416 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-53c32045-f890-4964-a651-6eb23b279f6c req-ee60d794-9e3a-40d0-9b2f-b160b6ae155e service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:13.801491 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-53c32045-f890-4964-a651-6eb23b279f6c req-ee60d794-9e3a-40d0-9b2f-b160b6ae155e service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:13.881802 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-53c32045-f890-4964-a651-6eb23b279f6c req-ee60d794-9e3a-40d0-9b2f-b160b6ae155e service nova] Creating event network-changed:c18fbf98-f795-40c5-946a-d03e103edc85 for instance b669ea21-79c9-4f4c-aa6b-e6c0cec96641 on hv-cinder-maste Oct 19 00:40:13.885499 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-53c32045-f890-4964-a651-6eb23b279f6c req-ee60d794-9e3a-40d0-9b2f-b160b6ae155e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=125531) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 00:40:13.887340 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-53c32045-f890-4964-a651-6eb23b279f6c req-ee60d794-9e3a-40d0-9b2f-b160b6ae155e service nova] Acquired lock "compute-rpcapi-router" {{(pid=125531) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 00:40:13.895753 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d74af069-455b-4dac-a542-f7c2911e42b9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:13.896590 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d74af069-455b-4dac-a542-f7c2911e42b9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:13.898354 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d74af069-455b-4dac-a542-f7c2911e42b9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:13.902106 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d74af069-455b-4dac-a542-f7c2911e42b9 None None] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:13.904500 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d74af069-455b-4dac-a542-f7c2911e42b9 None None] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:13.910866 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d74af069-455b-4dac-a542-f7c2911e42b9 None None] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:13.962161 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.compute.rpcapi [None req-d74af069-455b-4dac-a542-f7c2911e42b9 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 19 00:40:13.969189 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d74af069-455b-4dac-a542-f7c2911e42b9 None None] Releasing lock "compute-rpcapi-router" {{(pid=125531) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 00:40:14.019345 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-d74af069-455b-4dac-a542-f7c2911e42b9 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.894078 Oct 19 00:40:14.022765 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 19/47] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:40:14.039665 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-75c8ff77-126c-4843-a603-a45a275c5509 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:14.040426 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-75c8ff77-126c-4843-a603-a45a275c5509 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:14.058102 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-75c8ff77-126c-4843-a603-a45a275c5509 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:14.061792 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-75c8ff77-126c-4843-a603-a45a275c5509 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:14.062415 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-75c8ff77-126c-4843-a603-a45a275c5509 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:14.063318 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-75c8ff77-126c-4843-a603-a45a275c5509 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:14.063938 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-75c8ff77-126c-4843-a603-a45a275c5509 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:14.068880 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-75c8ff77-126c-4843-a603-a45a275c5509 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:14.213689 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-edeb5c61-a7a1-40e8-9c54-c5dc48772b05 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:14.224691 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-edeb5c61-a7a1-40e8-9c54-c5dc48772b05 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1321 microversion: 2.1 time: 1.139863 Oct 19 00:40:14.230324 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 29/48] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:13 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1321 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:14.244022 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-6e182d7d-3c17-4f3a-91a6-e719afccbb2b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:14.244882 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-6e182d7d-3c17-4f3a-91a6-e719afccbb2b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 361dfd3b-f488-4dac-9511-f28c93f74d37] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:14.257693 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6e182d7d-3c17-4f3a-91a6-e719afccbb2b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:14.258965 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6e182d7d-3c17-4f3a-91a6-e719afccbb2b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:14.261017 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6e182d7d-3c17-4f3a-91a6-e719afccbb2b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:14.265650 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6e182d7d-3c17-4f3a-91a6-e719afccbb2b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:14.268050 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6e182d7d-3c17-4f3a-91a6-e719afccbb2b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:14.268808 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6e182d7d-3c17-4f3a-91a6-e719afccbb2b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:14.393724 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-75c8ff77-126c-4843-a603-a45a275c5509 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda9dd9eb8d3446c96b0c702dd09d2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb46376a666496b896ad085315c58fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:14.404543 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-75c8ff77-126c-4843-a603-a45a275c5509 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641" status: 200 len: 1315 microversion: 2.1 time: 0.376160 Oct 19 00:40:14.405108 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 20/49] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:14 2022] GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 => generated 1315 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:14.412411 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-ccf3548b-728b-4b61-a749-5aaaba146419 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:14.436775 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-ccf3548b-728b-4b61-a749-5aaaba146419 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:14.452242 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ccf3548b-728b-4b61-a749-5aaaba146419 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:14.452883 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ccf3548b-728b-4b61-a749-5aaaba146419 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:14.453344 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ccf3548b-728b-4b61-a749-5aaaba146419 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:14.454106 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ccf3548b-728b-4b61-a749-5aaaba146419 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:14.454560 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ccf3548b-728b-4b61-a749-5aaaba146419 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:14.454991 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ccf3548b-728b-4b61-a749-5aaaba146419 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:14.583694 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-6e182d7d-3c17-4f3a-91a6-e719afccbb2b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:14.598178 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-6e182d7d-3c17-4f3a-91a6-e719afccbb2b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37" status: 200 len: 1298 microversion: 2.1 time: 0.366379 Oct 19 00:40:14.608118 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 30/50] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:14 2022] GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37 => generated 1298 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:14.792675 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-ccf3548b-728b-4b61-a749-5aaaba146419 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:14.814305 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-ccf3548b-728b-4b61-a749-5aaaba146419 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1242 microversion: 2.1 time: 0.404590 Oct 19 00:40:14.828074 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 21/51] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:14 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1242 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:14.828074 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-f8a4487a-1619-4e38-9fd4-91f2f8d11150 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:14.828074 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-f8a4487a-1619-4e38-9fd4-91f2f8d11150 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:14.831916 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f8a4487a-1619-4e38-9fd4-91f2f8d11150 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:14.832474 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f8a4487a-1619-4e38-9fd4-91f2f8d11150 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:14.832961 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f8a4487a-1619-4e38-9fd4-91f2f8d11150 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:14.834276 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f8a4487a-1619-4e38-9fd4-91f2f8d11150 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:14.834806 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f8a4487a-1619-4e38-9fd4-91f2f8d11150 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:14.835292 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f8a4487a-1619-4e38-9fd4-91f2f8d11150 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:14.956607 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-2ffdc9b3-3f5a-46d0-b95a-4e0c9cb54be3 req-0ff5fbcb-52dd-4045-874e-87a7d5dc6050 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c74fb45-ef8a-4a88-8126-21c8266fddb2", "tag": "7926b647-0ec9-46fb-9fed-f33f2ff9fbcf"}]} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:40:14.974377 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:14.977031 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-2ffdc9b3-3f5a-46d0-b95a-4e0c9cb54be3 req-0ff5fbcb-52dd-4045-874e-87a7d5dc6050 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:14.977761 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-2ffdc9b3-3f5a-46d0-b95a-4e0c9cb54be3 req-0ff5fbcb-52dd-4045-874e-87a7d5dc6050 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:14.978694 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-2ffdc9b3-3f5a-46d0-b95a-4e0c9cb54be3 req-0ff5fbcb-52dd-4045-874e-87a7d5dc6050 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:15.003539 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.compute.server_external_events [req-2ffdc9b3-3f5a-46d0-b95a-4e0c9cb54be3 req-0ff5fbcb-52dd-4045-874e-87a7d5dc6050 service nova] Creating event network-changed:7926b647-0ec9-46fb-9fed-f33f2ff9fbcf for instance 1c74fb45-ef8a-4a88-8126-21c8266fddb2 on hv-cinder-maste Oct 19 00:40:15.004755 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-2ffdc9b3-3f5a-46d0-b95a-4e0c9cb54be3 req-0ff5fbcb-52dd-4045-874e-87a7d5dc6050 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=125532) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 00:40:15.005367 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-2ffdc9b3-3f5a-46d0-b95a-4e0c9cb54be3 req-0ff5fbcb-52dd-4045-874e-87a7d5dc6050 service nova] Acquired lock "compute-rpcapi-router" {{(pid=125532) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 00:40:15.006907 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c1c900c8-4fc9-4e11-aae8-139aeca7c837 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:15.007589 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c1c900c8-4fc9-4e11-aae8-139aeca7c837 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:15.008264 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c1c900c8-4fc9-4e11-aae8-139aeca7c837 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:15.009212 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c1c900c8-4fc9-4e11-aae8-139aeca7c837 None None] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:15.009879 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c1c900c8-4fc9-4e11-aae8-139aeca7c837 None None] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:15.011109 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c1c900c8-4fc9-4e11-aae8-139aeca7c837 None None] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:15.022630 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.compute.rpcapi [None req-c1c900c8-4fc9-4e11-aae8-139aeca7c837 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 19 00:40:15.024785 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c1c900c8-4fc9-4e11-aae8-139aeca7c837 None None] Releasing lock "compute-rpcapi-router" {{(pid=125532) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 00:40:15.049912 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-c1c900c8-4fc9-4e11-aae8-139aeca7c837 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.448974 Oct 19 00:40:15.051771 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 31/52] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:40:15.071247 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-f8a4487a-1619-4e38-9fd4-91f2f8d11150 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:15.085403 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-f8a4487a-1619-4e38-9fd4-91f2f8d11150 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:15.087197 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-f8a4487a-1619-4e38-9fd4-91f2f8d11150 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:15.088763 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-f8a4487a-1619-4e38-9fd4-91f2f8d11150 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1407 microversion: 2.20 time: 0.272093 Oct 19 00:40:15.089569 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 22/53] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:40:14 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1407 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:40:15.259954 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-59d4624c-6cdc-44d9-b720-43e3123c21e2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:15.260792 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-59d4624c-6cdc-44d9-b720-43e3123c21e2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:15.282363 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-59d4624c-6cdc-44d9-b720-43e3123c21e2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:15.283205 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-59d4624c-6cdc-44d9-b720-43e3123c21e2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:15.283666 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-59d4624c-6cdc-44d9-b720-43e3123c21e2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:15.284453 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-59d4624c-6cdc-44d9-b720-43e3123c21e2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:15.284917 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-59d4624c-6cdc-44d9-b720-43e3123c21e2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:15.285349 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-59d4624c-6cdc-44d9-b720-43e3123c21e2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:15.432590 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-3a734d94-bf7b-49ac-96f2-ebe9aed9eb89 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:15.433463 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-3a734d94-bf7b-49ac-96f2-ebe9aed9eb89 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:15.442414 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3a734d94-bf7b-49ac-96f2-ebe9aed9eb89 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:15.443261 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3a734d94-bf7b-49ac-96f2-ebe9aed9eb89 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:15.443704 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3a734d94-bf7b-49ac-96f2-ebe9aed9eb89 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:15.444694 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3a734d94-bf7b-49ac-96f2-ebe9aed9eb89 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:15.445246 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3a734d94-bf7b-49ac-96f2-ebe9aed9eb89 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:15.445886 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3a734d94-bf7b-49ac-96f2-ebe9aed9eb89 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:15.633101 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-59d4624c-6cdc-44d9-b720-43e3123c21e2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:15.640065 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-3a734d94-bf7b-49ac-96f2-ebe9aed9eb89 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda9dd9eb8d3446c96b0c702dd09d2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb46376a666496b896ad085315c58fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:15.643510 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-59d4624c-6cdc-44d9-b720-43e3123c21e2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1321 microversion: 2.1 time: 0.387916 Oct 19 00:40:15.644117 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 32/54] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:15 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1321 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:15.650072 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-ff8958d5-0daf-483e-ba26-160d6117db5d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:15.650697 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-ff8958d5-0daf-483e-ba26-160d6117db5d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 361dfd3b-f488-4dac-9511-f28c93f74d37] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:15.668704 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ff8958d5-0daf-483e-ba26-160d6117db5d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:15.669205 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ff8958d5-0daf-483e-ba26-160d6117db5d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:15.669648 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ff8958d5-0daf-483e-ba26-160d6117db5d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:15.670897 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ff8958d5-0daf-483e-ba26-160d6117db5d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:15.671355 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ff8958d5-0daf-483e-ba26-160d6117db5d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:15.671788 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ff8958d5-0daf-483e-ba26-160d6117db5d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:15.674019 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-3a734d94-bf7b-49ac-96f2-ebe9aed9eb89 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641" status: 200 len: 1315 microversion: 2.1 time: 0.245475 Oct 19 00:40:15.675081 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 23/55] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:15 2022] GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:40:15.788548 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-ff8958d5-0daf-483e-ba26-160d6117db5d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:15.797329 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-ff8958d5-0daf-483e-ba26-160d6117db5d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37" status: 200 len: 1298 microversion: 2.1 time: 0.150807 Oct 19 00:40:15.812378 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 33/56] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:15 2022] GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37 => generated 1298 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:15.839900 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-27875ac2-4fcf-46cc-bf1d-5b166bb0756d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:15.840542 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-27875ac2-4fcf-46cc-bf1d-5b166bb0756d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:15.848152 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:15.872311 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-27875ac2-4fcf-46cc-bf1d-5b166bb0756d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:15.874955 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-27875ac2-4fcf-46cc-bf1d-5b166bb0756d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:15.876326 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-27875ac2-4fcf-46cc-bf1d-5b166bb0756d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:15.880025 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-27875ac2-4fcf-46cc-bf1d-5b166bb0756d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:15.884684 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-27875ac2-4fcf-46cc-bf1d-5b166bb0756d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:15.888749 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-27875ac2-4fcf-46cc-bf1d-5b166bb0756d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:16.018272 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-27875ac2-4fcf-46cc-bf1d-5b166bb0756d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:16.032199 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-27875ac2-4fcf-46cc-bf1d-5b166bb0756d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1290 microversion: 2.1 time: 0.194604 Oct 19 00:40:16.033697 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 24/57] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:15 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1290 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:16.058795 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-ca0ae4ba-21f2-4bfe-8a10-9dd2da4d0c0a req-7d80c836-af9b-4dea-94f3-06ff8202f9ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "961ac14f-b764-4468-baa3-a3aa1eb26627", "tag": "0d78e5c5-2afd-4926-8fbf-05fc0868ef06"}]} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:40:16.071467 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-ca0ae4ba-21f2-4bfe-8a10-9dd2da4d0c0a req-7d80c836-af9b-4dea-94f3-06ff8202f9ea service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:16.073958 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-ca0ae4ba-21f2-4bfe-8a10-9dd2da4d0c0a req-7d80c836-af9b-4dea-94f3-06ff8202f9ea service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:16.074478 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-ca0ae4ba-21f2-4bfe-8a10-9dd2da4d0c0a req-7d80c836-af9b-4dea-94f3-06ff8202f9ea service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:16.087285 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.compute.server_external_events [req-ca0ae4ba-21f2-4bfe-8a10-9dd2da4d0c0a req-7d80c836-af9b-4dea-94f3-06ff8202f9ea service nova] Creating event network-changed:0d78e5c5-2afd-4926-8fbf-05fc0868ef06 for instance 961ac14f-b764-4468-baa3-a3aa1eb26627 on hv-cinder-maste Oct 19 00:40:16.093605 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-ca0ae4ba-21f2-4bfe-8a10-9dd2da4d0c0a req-7d80c836-af9b-4dea-94f3-06ff8202f9ea service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039592 Oct 19 00:40:16.094859 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 34/58] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:40:16.118978 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-4b43d665-cdb3-401d-9e53-c131616f059c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:16.119935 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-4b43d665-cdb3-401d-9e53-c131616f059c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:16.133848 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4b43d665-cdb3-401d-9e53-c131616f059c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:16.134232 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4b43d665-cdb3-401d-9e53-c131616f059c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:16.134743 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4b43d665-cdb3-401d-9e53-c131616f059c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:16.135583 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4b43d665-cdb3-401d-9e53-c131616f059c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:16.136270 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4b43d665-cdb3-401d-9e53-c131616f059c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:16.136703 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4b43d665-cdb3-401d-9e53-c131616f059c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:16.392843 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-4b43d665-cdb3-401d-9e53-c131616f059c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:16.406972 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-4b43d665-cdb3-401d-9e53-c131616f059c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:16.408726 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-4b43d665-cdb3-401d-9e53-c131616f059c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:16.409852 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-4b43d665-cdb3-401d-9e53-c131616f059c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1407 microversion: 2.20 time: 0.297204 Oct 19 00:40:16.415889 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 25/59] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:40:16 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1407 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:40:16.674643 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-71b698ff-4a6b-4725-af59-8d91b3faad11 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:16.675556 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-71b698ff-4a6b-4725-af59-8d91b3faad11 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:16.683297 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-71b698ff-4a6b-4725-af59-8d91b3faad11 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:16.683961 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-71b698ff-4a6b-4725-af59-8d91b3faad11 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:16.684613 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-71b698ff-4a6b-4725-af59-8d91b3faad11 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:16.686107 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-71b698ff-4a6b-4725-af59-8d91b3faad11 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:16.686845 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-71b698ff-4a6b-4725-af59-8d91b3faad11 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:16.687503 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-71b698ff-4a6b-4725-af59-8d91b3faad11 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:16.697481 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-8aa0e7b4-70cd-412c-8b7e-afaf1baf1c08 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:16.707717 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-8aa0e7b4-70cd-412c-8b7e-afaf1baf1c08 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:16.721814 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8aa0e7b4-70cd-412c-8b7e-afaf1baf1c08 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:16.722305 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8aa0e7b4-70cd-412c-8b7e-afaf1baf1c08 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:16.722888 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8aa0e7b4-70cd-412c-8b7e-afaf1baf1c08 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:16.723746 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8aa0e7b4-70cd-412c-8b7e-afaf1baf1c08 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:16.724233 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8aa0e7b4-70cd-412c-8b7e-afaf1baf1c08 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:16.724650 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8aa0e7b4-70cd-412c-8b7e-afaf1baf1c08 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:17.114801 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-8aa0e7b4-70cd-412c-8b7e-afaf1baf1c08 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda9dd9eb8d3446c96b0c702dd09d2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb46376a666496b896ad085315c58fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:17.122795 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-8aa0e7b4-70cd-412c-8b7e-afaf1baf1c08 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641" status: 200 len: 1315 microversion: 2.1 time: 0.429387 Oct 19 00:40:17.136208 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 26/60] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:16 2022] GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 => generated 1315 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:40:17.145098 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-c6adba22-2347-43e3-9370-bc80ba40207b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:17.145954 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-c6adba22-2347-43e3-9370-bc80ba40207b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 361dfd3b-f488-4dac-9511-f28c93f74d37] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:17.153096 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c6adba22-2347-43e3-9370-bc80ba40207b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:17.153803 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c6adba22-2347-43e3-9370-bc80ba40207b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:17.154491 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c6adba22-2347-43e3-9370-bc80ba40207b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:17.155412 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c6adba22-2347-43e3-9370-bc80ba40207b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:17.156325 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c6adba22-2347-43e3-9370-bc80ba40207b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:17.156979 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c6adba22-2347-43e3-9370-bc80ba40207b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:17.230903 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-71b698ff-4a6b-4725-af59-8d91b3faad11 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:17.244341 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-71b698ff-4a6b-4725-af59-8d91b3faad11 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1321 microversion: 2.1 time: 0.574630 Oct 19 00:40:17.245359 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 35/61] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:16 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1321 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:17.252221 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-dcac8561-a4a1-4b75-9a9d-65b11f9fd540 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:17.253570 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-dcac8561-a4a1-4b75-9a9d-65b11f9fd540 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:17.263598 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dcac8561-a4a1-4b75-9a9d-65b11f9fd540 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:17.265196 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dcac8561-a4a1-4b75-9a9d-65b11f9fd540 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:17.266492 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dcac8561-a4a1-4b75-9a9d-65b11f9fd540 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:17.267676 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dcac8561-a4a1-4b75-9a9d-65b11f9fd540 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:17.270677 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dcac8561-a4a1-4b75-9a9d-65b11f9fd540 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:17.271376 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dcac8561-a4a1-4b75-9a9d-65b11f9fd540 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:17.299053 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell1:SELECT=100 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:17.377210 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-dcac8561-a4a1-4b75-9a9d-65b11f9fd540 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:17.393953 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-dcac8561-a4a1-4b75-9a9d-65b11f9fd540 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1290 microversion: 2.1 time: 0.146544 Oct 19 00:40:17.396794 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 36/62] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:17 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1290 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:17.402934 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-af636b73-617c-4b81-9fdd-1d6499cc3533 req-ca86c67f-3345-4123-8f4a-085cd647f19b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4389c416-28bf-4b8e-945e-386f38c16859", "tag": "aaf9d032-091b-4318-8721-bd06e12204aa"}]} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:40:17.418882 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-af636b73-617c-4b81-9fdd-1d6499cc3533 req-ca86c67f-3345-4123-8f4a-085cd647f19b service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:17.419582 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-af636b73-617c-4b81-9fdd-1d6499cc3533 req-ca86c67f-3345-4123-8f4a-085cd647f19b service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:17.420789 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-af636b73-617c-4b81-9fdd-1d6499cc3533 req-ca86c67f-3345-4123-8f4a-085cd647f19b service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:17.439608 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.compute.server_external_events [req-af636b73-617c-4b81-9fdd-1d6499cc3533 req-ca86c67f-3345-4123-8f4a-085cd647f19b service nova] Creating event network-changed:aaf9d032-091b-4318-8721-bd06e12204aa for instance 4389c416-28bf-4b8e-945e-386f38c16859 on hv-cinder-maste Oct 19 00:40:17.453361 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-af636b73-617c-4b81-9fdd-1d6499cc3533 req-ca86c67f-3345-4123-8f4a-085cd647f19b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054158 Oct 19 00:40:17.458014 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 37/63] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:40:17.468544 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-9a67bd75-89a4-42ed-9b63-c4cf3198e620 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:17.469671 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-9a67bd75-89a4-42ed-9b63-c4cf3198e620 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:17.478028 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9a67bd75-89a4-42ed-9b63-c4cf3198e620 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:17.479046 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9a67bd75-89a4-42ed-9b63-c4cf3198e620 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:17.480079 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9a67bd75-89a4-42ed-9b63-c4cf3198e620 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:17.481714 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9a67bd75-89a4-42ed-9b63-c4cf3198e620 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:17.483102 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9a67bd75-89a4-42ed-9b63-c4cf3198e620 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:17.483732 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9a67bd75-89a4-42ed-9b63-c4cf3198e620 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:17.533861 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-c6adba22-2347-43e3-9370-bc80ba40207b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:17.545519 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-c6adba22-2347-43e3-9370-bc80ba40207b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37" status: 200 len: 1366 microversion: 2.1 time: 0.407525 Oct 19 00:40:17.546854 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 27/64] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:17 2022] GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37 => generated 1366 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:17.782139 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-9a67bd75-89a4-42ed-9b63-c4cf3198e620 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:17.790259 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-9a67bd75-89a4-42ed-9b63-c4cf3198e620 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:17.791955 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-9a67bd75-89a4-42ed-9b63-c4cf3198e620 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:17.793286 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-9a67bd75-89a4-42ed-9b63-c4cf3198e620 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1407 microversion: 2.20 time: 0.333650 Oct 19 00:40:17.809321 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 38/65] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:40:17 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1407 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:40:18.151361 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-4a659c31-1288-46b7-88ba-ba8d34229138 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:18.152236 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-4a659c31-1288-46b7-88ba-ba8d34229138 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:18.162372 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4a659c31-1288-46b7-88ba-ba8d34229138 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:18.163236 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4a659c31-1288-46b7-88ba-ba8d34229138 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:18.163804 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4a659c31-1288-46b7-88ba-ba8d34229138 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:18.164663 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4a659c31-1288-46b7-88ba-ba8d34229138 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:18.165122 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4a659c31-1288-46b7-88ba-ba8d34229138 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:18.165534 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4a659c31-1288-46b7-88ba-ba8d34229138 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:18.267989 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-af9a2ee6-3b59-45c1-a33e-db4fd611dd61 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:18.268925 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-af9a2ee6-3b59-45c1-a33e-db4fd611dd61 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:18.275224 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-af9a2ee6-3b59-45c1-a33e-db4fd611dd61 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:18.275704 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-af9a2ee6-3b59-45c1-a33e-db4fd611dd61 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:18.276173 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-af9a2ee6-3b59-45c1-a33e-db4fd611dd61 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:18.277030 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-af9a2ee6-3b59-45c1-a33e-db4fd611dd61 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:18.277479 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-af9a2ee6-3b59-45c1-a33e-db4fd611dd61 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:18.277898 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-af9a2ee6-3b59-45c1-a33e-db4fd611dd61 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:18.329207 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-4a659c31-1288-46b7-88ba-ba8d34229138 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda9dd9eb8d3446c96b0c702dd09d2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb46376a666496b896ad085315c58fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:18.340618 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-4a659c31-1288-46b7-88ba-ba8d34229138 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641" status: 200 len: 1315 microversion: 2.1 time: 0.194973 Oct 19 00:40:18.341679 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 28/66] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:18 2022] GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:40:18.421067 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-82e12e69-cf6e-4f1c-ad75-008d8938d8a7 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:18.421067 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-82e12e69-cf6e-4f1c-ad75-008d8938d8a7 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:18.427251 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-82e12e69-cf6e-4f1c-ad75-008d8938d8a7 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:18.428305 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-82e12e69-cf6e-4f1c-ad75-008d8938d8a7 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:18.428766 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-82e12e69-cf6e-4f1c-ad75-008d8938d8a7 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:18.429485 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-82e12e69-cf6e-4f1c-ad75-008d8938d8a7 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:18.430216 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-82e12e69-cf6e-4f1c-ad75-008d8938d8a7 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:18.430652 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-82e12e69-cf6e-4f1c-ad75-008d8938d8a7 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:18.433066 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-af9a2ee6-3b59-45c1-a33e-db4fd611dd61 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:18.442693 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-af9a2ee6-3b59-45c1-a33e-db4fd611dd61 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1321 microversion: 2.1 time: 0.179679 Oct 19 00:40:18.443266 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 39/67] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:18 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:40:18.510927 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-82e12e69-cf6e-4f1c-ad75-008d8938d8a7 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:18.513320 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell1:SELECT=99 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:18.521444 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-82e12e69-cf6e-4f1c-ad75-008d8938d8a7 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1290 microversion: 2.1 time: 0.106466 Oct 19 00:40:18.522054 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 29/68] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:18 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1290 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:40:18.570188 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-d6340a86-962d-4ead-ba0e-6ea3b883bf7a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:18.570805 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-d6340a86-962d-4ead-ba0e-6ea3b883bf7a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 361dfd3b-f488-4dac-9511-f28c93f74d37] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:18.578069 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d6340a86-962d-4ead-ba0e-6ea3b883bf7a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:18.578764 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d6340a86-962d-4ead-ba0e-6ea3b883bf7a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:18.579385 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d6340a86-962d-4ead-ba0e-6ea3b883bf7a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:18.580754 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d6340a86-962d-4ead-ba0e-6ea3b883bf7a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:18.581341 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d6340a86-962d-4ead-ba0e-6ea3b883bf7a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:18.582203 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d6340a86-962d-4ead-ba0e-6ea3b883bf7a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:18.775050 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-d6340a86-962d-4ead-ba0e-6ea3b883bf7a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:18.785366 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-d6340a86-962d-4ead-ba0e-6ea3b883bf7a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37" status: 200 len: 1366 microversion: 2.1 time: 0.219362 Oct 19 00:40:18.800714 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 40/69] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:18 2022] GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:18.820308 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-6766b7e2-456f-48ca-9812-07407cd35356 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:18.821160 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-6766b7e2-456f-48ca-9812-07407cd35356 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:18.829433 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6766b7e2-456f-48ca-9812-07407cd35356 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:18.830126 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6766b7e2-456f-48ca-9812-07407cd35356 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:18.830739 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6766b7e2-456f-48ca-9812-07407cd35356 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:18.831609 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6766b7e2-456f-48ca-9812-07407cd35356 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:18.832273 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6766b7e2-456f-48ca-9812-07407cd35356 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:18.832876 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6766b7e2-456f-48ca-9812-07407cd35356 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:19.004979 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-6766b7e2-456f-48ca-9812-07407cd35356 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:19.013503 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-6766b7e2-456f-48ca-9812-07407cd35356 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:19.015298 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-6766b7e2-456f-48ca-9812-07407cd35356 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:19.016445 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-6766b7e2-456f-48ca-9812-07407cd35356 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1407 microversion: 2.20 time: 0.199990 Oct 19 00:40:19.017387 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 30/70] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:40:18 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:40:19.370505 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-fa50d9d7-33b7-46c4-98a1-4ba3a14c2fb1 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:19.371970 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-fa50d9d7-33b7-46c4-98a1-4ba3a14c2fb1 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:19.379769 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell0:SELECT=6 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:19.382053 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-fa50d9d7-33b7-46c4-98a1-4ba3a14c2fb1 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:19.383486 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-fa50d9d7-33b7-46c4-98a1-4ba3a14c2fb1 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:19.384508 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-fa50d9d7-33b7-46c4-98a1-4ba3a14c2fb1 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:19.385536 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-fa50d9d7-33b7-46c4-98a1-4ba3a14c2fb1 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:19.386703 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-fa50d9d7-33b7-46c4-98a1-4ba3a14c2fb1 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:19.387344 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-fa50d9d7-33b7-46c4-98a1-4ba3a14c2fb1 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:19.468217 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-552ca2e8-d00b-4aa0-9015-55be1e82f5a5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:19.468853 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-552ca2e8-d00b-4aa0-9015-55be1e82f5a5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:19.486618 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-552ca2e8-d00b-4aa0-9015-55be1e82f5a5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:19.487019 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-552ca2e8-d00b-4aa0-9015-55be1e82f5a5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:19.487459 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-552ca2e8-d00b-4aa0-9015-55be1e82f5a5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:19.488231 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-552ca2e8-d00b-4aa0-9015-55be1e82f5a5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:19.488696 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-552ca2e8-d00b-4aa0-9015-55be1e82f5a5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:19.489124 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-552ca2e8-d00b-4aa0-9015-55be1e82f5a5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:19.599573 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-fa50d9d7-33b7-46c4-98a1-4ba3a14c2fb1 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda9dd9eb8d3446c96b0c702dd09d2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb46376a666496b896ad085315c58fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:19.609814 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-fa50d9d7-33b7-46c4-98a1-4ba3a14c2fb1 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641" status: 200 len: 1315 microversion: 2.1 time: 0.247617 Oct 19 00:40:19.610711 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 41/71] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:19 2022] GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:19.625100 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-babb96b3-0b8f-42eb-befc-2414b61463b4 req-b91cd012-6906-4be3-83e8-06f1057ac255 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "361dfd3b-f488-4dac-9511-f28c93f74d37", "tag": "579ced1d-44c1-46ae-bffb-7e11769e3f01"}]} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:40:19.637933 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-babb96b3-0b8f-42eb-befc-2414b61463b4 req-b91cd012-6906-4be3-83e8-06f1057ac255 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:19.638573 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-babb96b3-0b8f-42eb-befc-2414b61463b4 req-b91cd012-6906-4be3-83e8-06f1057ac255 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:19.639109 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-babb96b3-0b8f-42eb-befc-2414b61463b4 req-b91cd012-6906-4be3-83e8-06f1057ac255 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:19.651665 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.compute.server_external_events [req-babb96b3-0b8f-42eb-befc-2414b61463b4 req-b91cd012-6906-4be3-83e8-06f1057ac255 service nova] Creating event network-changed:579ced1d-44c1-46ae-bffb-7e11769e3f01 for instance 361dfd3b-f488-4dac-9511-f28c93f74d37 on hv-cinder-maste Oct 19 00:40:19.658052 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-babb96b3-0b8f-42eb-befc-2414b61463b4 req-b91cd012-6906-4be3-83e8-06f1057ac255 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044379 Oct 19 00:40:19.658749 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 42/72] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:40:19.664377 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-cf33c8b3-06c2-4767-a229-053d850e6ff7 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:19.665147 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-cf33c8b3-06c2-4767-a229-053d850e6ff7 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:19.672314 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cf33c8b3-06c2-4767-a229-053d850e6ff7 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:19.672795 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cf33c8b3-06c2-4767-a229-053d850e6ff7 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:19.673231 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cf33c8b3-06c2-4767-a229-053d850e6ff7 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:19.673926 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cf33c8b3-06c2-4767-a229-053d850e6ff7 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:19.674375 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cf33c8b3-06c2-4767-a229-053d850e6ff7 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:19.674790 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cf33c8b3-06c2-4767-a229-053d850e6ff7 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:19.783031 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-552ca2e8-d00b-4aa0-9015-55be1e82f5a5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:19.792372 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-552ca2e8-d00b-4aa0-9015-55be1e82f5a5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1321 microversion: 2.1 time: 0.330241 Oct 19 00:40:19.793141 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 31/73] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:19 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1321 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:19.815504 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-bb6867c3-5900-4863-b066-54e8c641d1bc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:19.816449 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-bb6867c3-5900-4863-b066-54e8c641d1bc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 361dfd3b-f488-4dac-9511-f28c93f74d37] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:19.825342 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bb6867c3-5900-4863-b066-54e8c641d1bc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:19.826314 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bb6867c3-5900-4863-b066-54e8c641d1bc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:19.826909 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bb6867c3-5900-4863-b066-54e8c641d1bc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:19.827886 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bb6867c3-5900-4863-b066-54e8c641d1bc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:19.828492 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bb6867c3-5900-4863-b066-54e8c641d1bc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:19.829062 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bb6867c3-5900-4863-b066-54e8c641d1bc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:19.836832 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-cf33c8b3-06c2-4767-a229-053d850e6ff7 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:19.853463 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-cf33c8b3-06c2-4767-a229-053d850e6ff7 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1290 microversion: 2.1 time: 0.193445 Oct 19 00:40:19.864778 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 43/74] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:19 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1290 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:20.043417 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-175e8c6d-7a14-4184-9ec6-7310d2cf7928 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:20.052422 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-175e8c6d-7a14-4184-9ec6-7310d2cf7928 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:20.066671 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-175e8c6d-7a14-4184-9ec6-7310d2cf7928 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:20.084145 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-175e8c6d-7a14-4184-9ec6-7310d2cf7928 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:20.087156 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-175e8c6d-7a14-4184-9ec6-7310d2cf7928 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:20.089265 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-175e8c6d-7a14-4184-9ec6-7310d2cf7928 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:20.090462 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-175e8c6d-7a14-4184-9ec6-7310d2cf7928 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:20.095220 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-175e8c6d-7a14-4184-9ec6-7310d2cf7928 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:20.357537 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-175e8c6d-7a14-4184-9ec6-7310d2cf7928 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:20.368827 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-175e8c6d-7a14-4184-9ec6-7310d2cf7928 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:20.370517 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-175e8c6d-7a14-4184-9ec6-7310d2cf7928 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:20.374043 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-175e8c6d-7a14-4184-9ec6-7310d2cf7928 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1407 microversion: 2.20 time: 0.334602 Oct 19 00:40:20.374968 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 44/75] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:40:20 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1407 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:40:20.578528 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-bb6867c3-5900-4863-b066-54e8c641d1bc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:20.600377 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-bb6867c3-5900-4863-b066-54e8c641d1bc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37" status: 200 len: 1366 microversion: 2.1 time: 0.793025 Oct 19 00:40:20.602515 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 32/76] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:19 2022] GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37 => generated 1366 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:20.640190 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-237a5b1a-cd3b-4de4-9407-381dbd915765 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:20.640972 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-237a5b1a-cd3b-4de4-9407-381dbd915765 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:20.672143 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-237a5b1a-cd3b-4de4-9407-381dbd915765 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:20.673841 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-237a5b1a-cd3b-4de4-9407-381dbd915765 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:20.675993 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-237a5b1a-cd3b-4de4-9407-381dbd915765 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:20.677908 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-237a5b1a-cd3b-4de4-9407-381dbd915765 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:20.680269 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-237a5b1a-cd3b-4de4-9407-381dbd915765 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:20.682298 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-237a5b1a-cd3b-4de4-9407-381dbd915765 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:20.829196 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-d80c4daf-6c54-4dbe-90be-741d71c6d21f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:20.831261 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-d80c4daf-6c54-4dbe-90be-741d71c6d21f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:20.844001 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d80c4daf-6c54-4dbe-90be-741d71c6d21f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:20.844929 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d80c4daf-6c54-4dbe-90be-741d71c6d21f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:20.845519 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d80c4daf-6c54-4dbe-90be-741d71c6d21f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:20.847368 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d80c4daf-6c54-4dbe-90be-741d71c6d21f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:20.848105 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d80c4daf-6c54-4dbe-90be-741d71c6d21f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:20.848676 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d80c4daf-6c54-4dbe-90be-741d71c6d21f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:21.245032 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-d80c4daf-6c54-4dbe-90be-741d71c6d21f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:21.256030 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-d80c4daf-6c54-4dbe-90be-741d71c6d21f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1321 microversion: 2.1 time: 0.441721 Oct 19 00:40:21.256629 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 33/77] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:20 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1321 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:21.268518 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-119da988-eff8-4c51-a367-2ca5e1cd0890 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:21.269375 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-119da988-eff8-4c51-a367-2ca5e1cd0890 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:21.281726 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-119da988-eff8-4c51-a367-2ca5e1cd0890 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:21.282259 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-119da988-eff8-4c51-a367-2ca5e1cd0890 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:21.283319 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-119da988-eff8-4c51-a367-2ca5e1cd0890 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:21.284094 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-119da988-eff8-4c51-a367-2ca5e1cd0890 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:21.285391 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-119da988-eff8-4c51-a367-2ca5e1cd0890 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:21.286148 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-119da988-eff8-4c51-a367-2ca5e1cd0890 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:21.349824 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-237a5b1a-cd3b-4de4-9407-381dbd915765 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda9dd9eb8d3446c96b0c702dd09d2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb46376a666496b896ad085315c58fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:21.363095 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-237a5b1a-cd3b-4de4-9407-381dbd915765 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641" status: 200 len: 1315 microversion: 2.1 time: 0.727153 Oct 19 00:40:21.368045 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 45/78] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:20 2022] GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 => generated 1315 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:21.405552 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-5cacbfb9-aed7-4e9d-83da-51e487876ab9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:21.407457 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-5cacbfb9-aed7-4e9d-83da-51e487876ab9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:21.423254 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-119da988-eff8-4c51-a367-2ca5e1cd0890 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:21.428945 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5cacbfb9-aed7-4e9d-83da-51e487876ab9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:21.429873 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5cacbfb9-aed7-4e9d-83da-51e487876ab9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:21.430609 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5cacbfb9-aed7-4e9d-83da-51e487876ab9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:21.432002 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5cacbfb9-aed7-4e9d-83da-51e487876ab9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:21.432652 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5cacbfb9-aed7-4e9d-83da-51e487876ab9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:21.433326 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5cacbfb9-aed7-4e9d-83da-51e487876ab9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:21.437228 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-119da988-eff8-4c51-a367-2ca5e1cd0890 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1296 microversion: 2.1 time: 0.176812 Oct 19 00:40:21.437916 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 34/79] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:21 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1296 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:21.632969 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-81507cd8-22de-4b39-a7ce-91383a5818a4 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:21.635700 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-81507cd8-22de-4b39-a7ce-91383a5818a4 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 361dfd3b-f488-4dac-9511-f28c93f74d37] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:21.648393 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-81507cd8-22de-4b39-a7ce-91383a5818a4 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:21.651233 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-81507cd8-22de-4b39-a7ce-91383a5818a4 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:21.652127 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-81507cd8-22de-4b39-a7ce-91383a5818a4 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:21.656197 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-81507cd8-22de-4b39-a7ce-91383a5818a4 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:21.657676 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-81507cd8-22de-4b39-a7ce-91383a5818a4 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:21.658582 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-81507cd8-22de-4b39-a7ce-91383a5818a4 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:21.753499 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-5cacbfb9-aed7-4e9d-83da-51e487876ab9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:21.762869 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-5cacbfb9-aed7-4e9d-83da-51e487876ab9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:21.766072 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-5cacbfb9-aed7-4e9d-83da-51e487876ab9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:21.767876 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-5cacbfb9-aed7-4e9d-83da-51e487876ab9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1407 microversion: 2.20 time: 0.367456 Oct 19 00:40:21.768576 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 46/80] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:40:21 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1407 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:40:21.858642 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-81507cd8-22de-4b39-a7ce-91383a5818a4 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:21.867610 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-81507cd8-22de-4b39-a7ce-91383a5818a4 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37" status: 200 len: 1366 microversion: 2.1 time: 0.242828 Oct 19 00:40:21.868207 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 35/81] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:21 2022] GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:22.289719 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-45cba27b-1cc9-468f-a720-890fd7d01296 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:22.290521 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-45cba27b-1cc9-468f-a720-890fd7d01296 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:22.296600 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-45cba27b-1cc9-468f-a720-890fd7d01296 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:22.297300 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-45cba27b-1cc9-468f-a720-890fd7d01296 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:22.297896 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-45cba27b-1cc9-468f-a720-890fd7d01296 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:22.298588 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-45cba27b-1cc9-468f-a720-890fd7d01296 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:22.299183 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-45cba27b-1cc9-468f-a720-890fd7d01296 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:22.299755 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-45cba27b-1cc9-468f-a720-890fd7d01296 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:22.390421 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-54743deb-804a-42fd-b14c-cc9eeeaf4952 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:22.391275 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-54743deb-804a-42fd-b14c-cc9eeeaf4952 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:22.401087 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-54743deb-804a-42fd-b14c-cc9eeeaf4952 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:22.404081 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-54743deb-804a-42fd-b14c-cc9eeeaf4952 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:22.405369 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-54743deb-804a-42fd-b14c-cc9eeeaf4952 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:22.406262 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-54743deb-804a-42fd-b14c-cc9eeeaf4952 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:22.406870 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-54743deb-804a-42fd-b14c-cc9eeeaf4952 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:22.407915 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-54743deb-804a-42fd-b14c-cc9eeeaf4952 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:22.496879 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-45cba27b-1cc9-468f-a720-890fd7d01296 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:22.510366 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-45cba27b-1cc9-468f-a720-890fd7d01296 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1321 microversion: 2.1 time: 0.225024 Oct 19 00:40:22.525091 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 47/82] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:22 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:22.537379 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-f106fe22-9dd8-4f08-838a-689e667f7869 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:22.538093 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-f106fe22-9dd8-4f08-838a-689e667f7869 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:22.546080 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f106fe22-9dd8-4f08-838a-689e667f7869 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:22.546627 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f106fe22-9dd8-4f08-838a-689e667f7869 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:22.547098 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f106fe22-9dd8-4f08-838a-689e667f7869 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:22.548345 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f106fe22-9dd8-4f08-838a-689e667f7869 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:22.549011 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f106fe22-9dd8-4f08-838a-689e667f7869 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:22.549663 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f106fe22-9dd8-4f08-838a-689e667f7869 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:22.665585 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-54743deb-804a-42fd-b14c-cc9eeeaf4952 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda9dd9eb8d3446c96b0c702dd09d2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb46376a666496b896ad085315c58fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:22.675642 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-f106fe22-9dd8-4f08-838a-689e667f7869 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:22.677094 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-54743deb-804a-42fd-b14c-cc9eeeaf4952 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641" status: 200 len: 1315 microversion: 2.1 time: 0.292336 Oct 19 00:40:22.677825 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 36/83] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:22 2022] GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:40:22.693605 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-f106fe22-9dd8-4f08-838a-689e667f7869 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1296 microversion: 2.1 time: 0.166494 Oct 19 00:40:22.708202 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 48/84] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:22 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1296 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:22.794154 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-9b2dd03e-d215-4092-8d91-1f19bb5d4e28 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:22.795968 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-9b2dd03e-d215-4092-8d91-1f19bb5d4e28 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:22.802311 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9b2dd03e-d215-4092-8d91-1f19bb5d4e28 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:22.802795 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9b2dd03e-d215-4092-8d91-1f19bb5d4e28 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:22.803233 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9b2dd03e-d215-4092-8d91-1f19bb5d4e28 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:22.803958 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9b2dd03e-d215-4092-8d91-1f19bb5d4e28 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:22.804613 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9b2dd03e-d215-4092-8d91-1f19bb5d4e28 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:22.805195 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9b2dd03e-d215-4092-8d91-1f19bb5d4e28 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:22.848576 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell0:SELECT=28 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:22.890715 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-c377561f-ae2f-48e9-af04-9beb3c6c9fd6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:22.891531 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-c377561f-ae2f-48e9-af04-9beb3c6c9fd6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 361dfd3b-f488-4dac-9511-f28c93f74d37] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:22.900188 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c377561f-ae2f-48e9-af04-9beb3c6c9fd6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:22.903835 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c377561f-ae2f-48e9-af04-9beb3c6c9fd6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:22.904509 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c377561f-ae2f-48e9-af04-9beb3c6c9fd6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:22.905598 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c377561f-ae2f-48e9-af04-9beb3c6c9fd6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:22.906159 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c377561f-ae2f-48e9-af04-9beb3c6c9fd6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:22.906649 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c377561f-ae2f-48e9-af04-9beb3c6c9fd6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:23.114587 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-c377561f-ae2f-48e9-af04-9beb3c6c9fd6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:23.123675 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-c377561f-ae2f-48e9-af04-9beb3c6c9fd6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37" status: 200 len: 1366 microversion: 2.1 time: 0.236365 Oct 19 00:40:23.126411 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 49/85] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:22 2022] GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37 => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:23.257767 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-9b2dd03e-d215-4092-8d91-1f19bb5d4e28 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:23.274442 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-9b2dd03e-d215-4092-8d91-1f19bb5d4e28 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:23.284344 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-9b2dd03e-d215-4092-8d91-1f19bb5d4e28 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:23.286152 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-9b2dd03e-d215-4092-8d91-1f19bb5d4e28 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1407 microversion: 2.20 time: 0.495883 Oct 19 00:40:23.287399 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 37/86] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:40:22 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1407 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:40:23.437621 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-aaaa7a26-7d59-4584-88a2-e006f730c2a6 req-ffbafe11-c028-49e8-99a5-1079a7c6de98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b669ea21-79c9-4f4c-aa6b-e6c0cec96641", "name": "network-vif-plugged", "status": "completed", "tag": "c18fbf98-f795-40c5-946a-d03e103edc85"}]} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:40:23.452834 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-aaaa7a26-7d59-4584-88a2-e006f730c2a6 req-ffbafe11-c028-49e8-99a5-1079a7c6de98 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:23.453571 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-aaaa7a26-7d59-4584-88a2-e006f730c2a6 req-ffbafe11-c028-49e8-99a5-1079a7c6de98 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:23.454148 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-aaaa7a26-7d59-4584-88a2-e006f730c2a6 req-ffbafe11-c028-49e8-99a5-1079a7c6de98 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:23.467573 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.compute.server_external_events [req-aaaa7a26-7d59-4584-88a2-e006f730c2a6 req-ffbafe11-c028-49e8-99a5-1079a7c6de98 service nova] Creating event network-vif-plugged:c18fbf98-f795-40c5-946a-d03e103edc85 for instance b669ea21-79c9-4f4c-aa6b-e6c0cec96641 on hv-cinder-maste Oct 19 00:40:23.472860 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-aaaa7a26-7d59-4584-88a2-e006f730c2a6 req-ffbafe11-c028-49e8-99a5-1079a7c6de98 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.236756 Oct 19 00:40:23.473783 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 50/87] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:40:23.537273 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-42b9cdc8-3b0c-49a2-acf1-59c030428532 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:23.538147 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-42b9cdc8-3b0c-49a2-acf1-59c030428532 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:23.557307 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-42b9cdc8-3b0c-49a2-acf1-59c030428532 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:23.558045 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-42b9cdc8-3b0c-49a2-acf1-59c030428532 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:23.558629 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-42b9cdc8-3b0c-49a2-acf1-59c030428532 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:23.559529 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-42b9cdc8-3b0c-49a2-acf1-59c030428532 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:23.560179 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-42b9cdc8-3b0c-49a2-acf1-59c030428532 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:23.561780 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-42b9cdc8-3b0c-49a2-acf1-59c030428532 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:23.705489 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-47592e5e-5716-4220-a233-4cfc050cbb71 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:23.708398 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-47592e5e-5716-4220-a233-4cfc050cbb71 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:23.722721 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-47592e5e-5716-4220-a233-4cfc050cbb71 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:23.723498 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-47592e5e-5716-4220-a233-4cfc050cbb71 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:23.724204 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-47592e5e-5716-4220-a233-4cfc050cbb71 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:23.725190 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-47592e5e-5716-4220-a233-4cfc050cbb71 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:23.726409 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-47592e5e-5716-4220-a233-4cfc050cbb71 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:23.727291 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-47592e5e-5716-4220-a233-4cfc050cbb71 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:23.889176 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-42b9cdc8-3b0c-49a2-acf1-59c030428532 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:23.899156 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-42b9cdc8-3b0c-49a2-acf1-59c030428532 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1321 microversion: 2.1 time: 0.365583 Oct 19 00:40:23.899994 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 38/88] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:23 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1321 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:23.922305 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-273cd407-4512-4fc5-a85b-c4a707735aed tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:23.923369 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-273cd407-4512-4fc5-a85b-c4a707735aed tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:23.930145 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-273cd407-4512-4fc5-a85b-c4a707735aed tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:23.930609 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-273cd407-4512-4fc5-a85b-c4a707735aed tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:23.931042 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-273cd407-4512-4fc5-a85b-c4a707735aed tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:23.931793 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-273cd407-4512-4fc5-a85b-c4a707735aed tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:23.932225 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-273cd407-4512-4fc5-a85b-c4a707735aed tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:23.932658 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-273cd407-4512-4fc5-a85b-c4a707735aed tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:23.961916 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell0:SELECT=8 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:24.035940 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-273cd407-4512-4fc5-a85b-c4a707735aed tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:24.051994 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-273cd407-4512-4fc5-a85b-c4a707735aed tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1296 microversion: 2.1 time: 0.137688 Oct 19 00:40:24.052584 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 39/89] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:23 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1296 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:24.089808 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-47592e5e-5716-4220-a233-4cfc050cbb71 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda9dd9eb8d3446c96b0c702dd09d2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb46376a666496b896ad085315c58fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:24.098794 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-47592e5e-5716-4220-a233-4cfc050cbb71 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641" status: 200 len: 1315 microversion: 2.1 time: 0.399016 Oct 19 00:40:24.100224 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 51/90] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:23 2022] GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:24.150460 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-ef1830b5-3b0c-4c0c-9a43-5d0784dae60f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:24.151539 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-ef1830b5-3b0c-4c0c-9a43-5d0784dae60f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 361dfd3b-f488-4dac-9511-f28c93f74d37] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:24.162951 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ef1830b5-3b0c-4c0c-9a43-5d0784dae60f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:24.163474 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ef1830b5-3b0c-4c0c-9a43-5d0784dae60f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:24.163924 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ef1830b5-3b0c-4c0c-9a43-5d0784dae60f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:24.164598 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ef1830b5-3b0c-4c0c-9a43-5d0784dae60f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:24.167805 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ef1830b5-3b0c-4c0c-9a43-5d0784dae60f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:24.168433 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ef1830b5-3b0c-4c0c-9a43-5d0784dae60f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:24.314449 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-0206e293-9ac0-4521-b542-1fcc881f6d9c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:24.315342 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-0206e293-9ac0-4521-b542-1fcc881f6d9c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:24.326964 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0206e293-9ac0-4521-b542-1fcc881f6d9c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:24.328983 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0206e293-9ac0-4521-b542-1fcc881f6d9c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:24.329700 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0206e293-9ac0-4521-b542-1fcc881f6d9c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:24.336202 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0206e293-9ac0-4521-b542-1fcc881f6d9c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:24.336896 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0206e293-9ac0-4521-b542-1fcc881f6d9c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:24.337977 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0206e293-9ac0-4521-b542-1fcc881f6d9c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:24.406670 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-ef1830b5-3b0c-4c0c-9a43-5d0784dae60f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:24.415615 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-ef1830b5-3b0c-4c0c-9a43-5d0784dae60f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37" status: 200 len: 1366 microversion: 2.1 time: 0.269921 Oct 19 00:40:24.427881 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 40/91] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:24 2022] GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37 => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:24.634094 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-0206e293-9ac0-4521-b542-1fcc881f6d9c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:24.644544 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-0206e293-9ac0-4521-b542-1fcc881f6d9c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:24.645970 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-0206e293-9ac0-4521-b542-1fcc881f6d9c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:24.651300 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-0206e293-9ac0-4521-b542-1fcc881f6d9c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1407 microversion: 2.20 time: 0.342236 Oct 19 00:40:24.668411 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 52/92] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:40:24 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1407 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:40:24.693469 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-2e82c2b2-01d8-410e-addc-664ca09dd0ad tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-722449864", "imageRef": "d1f4abc9-3bb9-4343-9a05-53d758070c9d", "flavorRef": "452", "networks": [{"uuid": "5f436b95-d740-4d38-8471-d8a2c1e7adfa"}]}} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:40:24.767632 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.network.neutron [None req-2e82c2b2-01d8-410e-addc-664ca09dd0ad tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] validate_networks() for [('5f436b95-d740-4d38-8471-d8a2c1e7adfa', None, None, None, None, None)] {{(pid=125531) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:40:24.929712 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-b1d79345-549a-4517-b548-8628f9598f71 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:24.933159 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-b1d79345-549a-4517-b548-8628f9598f71 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:24.945939 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b1d79345-549a-4517-b548-8628f9598f71 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:24.946769 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b1d79345-549a-4517-b548-8628f9598f71 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:24.947564 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b1d79345-549a-4517-b548-8628f9598f71 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:24.948484 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b1d79345-549a-4517-b548-8628f9598f71 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:24.949504 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b1d79345-549a-4517-b548-8628f9598f71 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:24.950096 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b1d79345-549a-4517-b548-8628f9598f71 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:25.021153 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell0:SELECT=4 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:25.227484 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-b1d79345-549a-4517-b548-8628f9598f71 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:25.237004 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-b1d79345-549a-4517-b548-8628f9598f71 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1321 microversion: 2.1 time: 0.315305 Oct 19 00:40:25.245892 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 53/93] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:24 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1321 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:25.257147 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-23291d67-65ed-4a23-b714-3c0cd8f1c053 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:25.258296 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-23291d67-65ed-4a23-b714-3c0cd8f1c053 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:25.266409 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-23291d67-65ed-4a23-b714-3c0cd8f1c053 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:25.267730 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-23291d67-65ed-4a23-b714-3c0cd8f1c053 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:25.268474 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-23291d67-65ed-4a23-b714-3c0cd8f1c053 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:25.269579 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-23291d67-65ed-4a23-b714-3c0cd8f1c053 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:25.270214 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-23291d67-65ed-4a23-b714-3c0cd8f1c053 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:25.270789 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-23291d67-65ed-4a23-b714-3c0cd8f1c053 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:25.390922 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-2e82c2b2-01d8-410e-addc-664ca09dd0ad tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Flavor limits 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:40:25.392428 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-2e82c2b2-01d8-410e-addc-664ca09dd0ad tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Image limits 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:40:25.393140 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-2e82c2b2-01d8-410e-addc-664ca09dd0ad tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Flavor pref 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:40:25.393978 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-2e82c2b2-01d8-410e-addc-664ca09dd0ad tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Image pref 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:40:25.394759 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-2e82c2b2-01d8-410e-addc-664ca09dd0ad tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:40:25.407723 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2e82c2b2-01d8-410e-addc-664ca09dd0ad tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:25.408573 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2e82c2b2-01d8-410e-addc-664ca09dd0ad tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:25.409849 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2e82c2b2-01d8-410e-addc-664ca09dd0ad tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:25.410863 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2e82c2b2-01d8-410e-addc-664ca09dd0ad tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:25.412097 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2e82c2b2-01d8-410e-addc-664ca09dd0ad tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:25.412769 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2e82c2b2-01d8-410e-addc-664ca09dd0ad tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:25.437867 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.quota [None req-2e82c2b2-01d8-410e-addc-664ca09dd0ad tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Getting quotas for project 78099a2acb31422095531592b7c2da20. Resources: {'instances', 'cores', 'ram'} {{(pid=125531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:40:25.444429 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.quota [None req-2e82c2b2-01d8-410e-addc-664ca09dd0ad tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Getting quotas for user a76e5b2b9d844730bf0c955c1c47b582 and project 78099a2acb31422095531592b7c2da20. Resources: {'instances', 'cores', 'ram'} {{(pid=125531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:40:25.452984 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-23291d67-65ed-4a23-b714-3c0cd8f1c053 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:25.461323 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-2e82c2b2-01d8-410e-addc-664ca09dd0ad tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Going to run 1 instances... {{(pid=125531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:40:25.464170 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-23291d67-65ed-4a23-b714-3c0cd8f1c053 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1364 microversion: 2.1 time: 0.216980 Oct 19 00:40:25.464809 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-2e82c2b2-01d8-410e-addc-664ca09dd0ad tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] [instance: 27c84340-8c49-4f3f-8c36-eb1a2cdaa804] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1f4abc9-3bb9-4343-9a05-53d758070c9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:40:25.476479 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 54/94] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:25 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1364 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:25.486674 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-2b011d0c-1577-4673-b65c-ef1cf6863a4f tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:25.487551 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-2b011d0c-1577-4673-b65c-ef1cf6863a4f tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:25.497255 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2b011d0c-1577-4673-b65c-ef1cf6863a4f tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:25.498325 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2b011d0c-1577-4673-b65c-ef1cf6863a4f tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:25.499184 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2b011d0c-1577-4673-b65c-ef1cf6863a4f tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:25.500271 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2b011d0c-1577-4673-b65c-ef1cf6863a4f tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:25.500926 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2b011d0c-1577-4673-b65c-ef1cf6863a4f tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:25.501587 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2b011d0c-1577-4673-b65c-ef1cf6863a4f tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:25.506556 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell1:SELECT=100 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:25.522039 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-2e82c2b2-01d8-410e-addc-664ca09dd0ad tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.088577 Oct 19 00:40:25.527336 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 41/95] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Oct 19 00:40:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 00:40:25.540275 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-50a3cc0f-84a8-4087-b86a-8b7a30433d15 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:25.541164 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-50a3cc0f-84a8-4087-b86a-8b7a30433d15 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 361dfd3b-f488-4dac-9511-f28c93f74d37] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:25.549540 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-50a3cc0f-84a8-4087-b86a-8b7a30433d15 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:25.550345 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-50a3cc0f-84a8-4087-b86a-8b7a30433d15 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:25.550936 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-50a3cc0f-84a8-4087-b86a-8b7a30433d15 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:25.551992 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-50a3cc0f-84a8-4087-b86a-8b7a30433d15 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:25.552586 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-50a3cc0f-84a8-4087-b86a-8b7a30433d15 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:25.553565 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-50a3cc0f-84a8-4087-b86a-8b7a30433d15 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:25.675838 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-2b011d0c-1577-4673-b65c-ef1cf6863a4f tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda9dd9eb8d3446c96b0c702dd09d2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb46376a666496b896ad085315c58fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:25.684173 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-2b011d0c-1577-4673-b65c-ef1cf6863a4f tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641" status: 200 len: 1315 microversion: 2.1 time: 0.206345 Oct 19 00:40:25.684742 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 55/96] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:25 2022] GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:25.694581 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-6d8e2758-a3e8-4b53-8d89-91bcf38e5e28 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:25.695726 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-6d8e2758-a3e8-4b53-8d89-91bcf38e5e28 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] [instance: 27c84340-8c49-4f3f-8c36-eb1a2cdaa804] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:25.754606 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-50a3cc0f-84a8-4087-b86a-8b7a30433d15 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:25.764283 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-50a3cc0f-84a8-4087-b86a-8b7a30433d15 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37" status: 200 len: 1366 microversion: 2.1 time: 0.235598 Oct 19 00:40:25.767507 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 42/97] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:25 2022] GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:25.772987 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-05f62380-a543-4983-a4bd-53fb9eed1543 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:25.777284 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-05f62380-a543-4983-a4bd-53fb9eed1543 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:25.792433 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-05f62380-a543-4983-a4bd-53fb9eed1543 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:25.793148 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-05f62380-a543-4983-a4bd-53fb9eed1543 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:25.793809 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-05f62380-a543-4983-a4bd-53fb9eed1543 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:25.795331 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-05f62380-a543-4983-a4bd-53fb9eed1543 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:25.796017 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-05f62380-a543-4983-a4bd-53fb9eed1543 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:25.796607 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-05f62380-a543-4983-a4bd-53fb9eed1543 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:25.798309 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-6d8e2758-a3e8-4b53-8d89-91bcf38e5e28 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e5b2b9d844730bf0c955c1c47b582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78099a2acb31422095531592b7c2da20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:25.806978 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-6d8e2758-a3e8-4b53-8d89-91bcf38e5e28 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] 10.222.0.33 "GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804" status: 200 len: 1213 microversion: 2.1 time: 0.117909 Oct 19 00:40:25.819877 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 56/98] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:25 2022] GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804 => generated 1213 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:26.173711 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-05f62380-a543-4983-a4bd-53fb9eed1543 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:26.188120 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-05f62380-a543-4983-a4bd-53fb9eed1543 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:26.189785 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-05f62380-a543-4983-a4bd-53fb9eed1543 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:26.190848 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-05f62380-a543-4983-a4bd-53fb9eed1543 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1407 microversion: 2.20 time: 0.421643 Oct 19 00:40:26.191927 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 43/99] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:40:25 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1407 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:40:26.262271 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-b2e01051-ec5a-4215-91a6-8ee33564ed9f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:26.262891 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-b2e01051-ec5a-4215-91a6-8ee33564ed9f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:26.269446 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b2e01051-ec5a-4215-91a6-8ee33564ed9f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:26.269932 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b2e01051-ec5a-4215-91a6-8ee33564ed9f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:26.270366 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b2e01051-ec5a-4215-91a6-8ee33564ed9f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:26.271064 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b2e01051-ec5a-4215-91a6-8ee33564ed9f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:26.271517 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b2e01051-ec5a-4215-91a6-8ee33564ed9f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:26.271969 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b2e01051-ec5a-4215-91a6-8ee33564ed9f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:26.490959 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-fce0adc4-e293-4fd0-8a81-96f8e82e83b9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:26.491722 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-fce0adc4-e293-4fd0-8a81-96f8e82e83b9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:26.499424 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fce0adc4-e293-4fd0-8a81-96f8e82e83b9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:26.499939 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fce0adc4-e293-4fd0-8a81-96f8e82e83b9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:26.500389 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fce0adc4-e293-4fd0-8a81-96f8e82e83b9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:26.501093 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fce0adc4-e293-4fd0-8a81-96f8e82e83b9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:26.501570 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fce0adc4-e293-4fd0-8a81-96f8e82e83b9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:26.506019 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fce0adc4-e293-4fd0-8a81-96f8e82e83b9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:26.560168 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-b2e01051-ec5a-4215-91a6-8ee33564ed9f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:26.568903 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-b2e01051-ec5a-4215-91a6-8ee33564ed9f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1321 microversion: 2.1 time: 0.310881 Oct 19 00:40:26.569536 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 57/100] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:26 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1321 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:26.696890 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-fce0adc4-e293-4fd0-8a81-96f8e82e83b9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:26.709015 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-e74810a2-7e03-4b58-b828-a52094937a41 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:26.709633 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-e74810a2-7e03-4b58-b828-a52094937a41 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:26.724260 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e74810a2-7e03-4b58-b828-a52094937a41 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:26.726097 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e74810a2-7e03-4b58-b828-a52094937a41 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:26.726689 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-fce0adc4-e293-4fd0-8a81-96f8e82e83b9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1364 microversion: 2.1 time: 0.241550 Oct 19 00:40:26.727435 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 44/101] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:26 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1364 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:40:26.728270 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e74810a2-7e03-4b58-b828-a52094937a41 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:26.729198 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e74810a2-7e03-4b58-b828-a52094937a41 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:26.729869 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e74810a2-7e03-4b58-b828-a52094937a41 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:26.730641 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e74810a2-7e03-4b58-b828-a52094937a41 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:26.790174 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-03123e91-8790-4470-a287-3022052eea21 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:26.790797 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-03123e91-8790-4470-a287-3022052eea21 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 361dfd3b-f488-4dac-9511-f28c93f74d37] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:26.801464 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-03123e91-8790-4470-a287-3022052eea21 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:26.801978 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-03123e91-8790-4470-a287-3022052eea21 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:26.802409 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-03123e91-8790-4470-a287-3022052eea21 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:26.803127 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-03123e91-8790-4470-a287-3022052eea21 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:26.803583 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-03123e91-8790-4470-a287-3022052eea21 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:26.804040 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-03123e91-8790-4470-a287-3022052eea21 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:27.017403 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-03123e91-8790-4470-a287-3022052eea21 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:27.027043 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-03123e91-8790-4470-a287-3022052eea21 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37" status: 200 len: 1366 microversion: 2.1 time: 0.240492 Oct 19 00:40:27.028705 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 45/102] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:26 2022] GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37 => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:27.056065 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-a5d3e55a-c15b-4554-bd18-0a076f83bf8e tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:27.056695 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-a5d3e55a-c15b-4554-bd18-0a076f83bf8e tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] [instance: 27c84340-8c49-4f3f-8c36-eb1a2cdaa804] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:27.065622 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a5d3e55a-c15b-4554-bd18-0a076f83bf8e tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:27.066135 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a5d3e55a-c15b-4554-bd18-0a076f83bf8e tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:27.066581 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a5d3e55a-c15b-4554-bd18-0a076f83bf8e tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:27.067771 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a5d3e55a-c15b-4554-bd18-0a076f83bf8e tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:27.068394 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a5d3e55a-c15b-4554-bd18-0a076f83bf8e tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:27.069022 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a5d3e55a-c15b-4554-bd18-0a076f83bf8e tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:27.131118 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-e74810a2-7e03-4b58-b828-a52094937a41 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda9dd9eb8d3446c96b0c702dd09d2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb46376a666496b896ad085315c58fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:27.147362 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-e74810a2-7e03-4b58-b828-a52094937a41 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641" status: 200 len: 1315 microversion: 2.1 time: 0.443527 Oct 19 00:40:27.149720 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 58/103] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:26 2022] GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:27.156111 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-aead3c4d-37c2-4a2c-bd6f-4649c45fa4bc req-07a6e10d-09de-44e2-a712-7aaa68604f0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c74fb45-ef8a-4a88-8126-21c8266fddb2", "name": "network-vif-plugged", "status": "completed", "tag": "7926b647-0ec9-46fb-9fed-f33f2ff9fbcf"}]} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:40:27.202562 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-aead3c4d-37c2-4a2c-bd6f-4649c45fa4bc req-07a6e10d-09de-44e2-a712-7aaa68604f0b service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:27.203158 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-aead3c4d-37c2-4a2c-bd6f-4649c45fa4bc req-07a6e10d-09de-44e2-a712-7aaa68604f0b service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:27.203604 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-aead3c4d-37c2-4a2c-bd6f-4649c45fa4bc req-07a6e10d-09de-44e2-a712-7aaa68604f0b service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:27.211262 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-a5d3e55a-c15b-4554-bd18-0a076f83bf8e tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e5b2b9d844730bf0c955c1c47b582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78099a2acb31422095531592b7c2da20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:27.227252 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-a5d3e55a-c15b-4554-bd18-0a076f83bf8e tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] 10.222.0.33 "GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804" status: 200 len: 1217 microversion: 2.1 time: 0.197004 Oct 19 00:40:27.230522 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.compute.server_external_events [req-aead3c4d-37c2-4a2c-bd6f-4649c45fa4bc req-07a6e10d-09de-44e2-a712-7aaa68604f0b service nova] Creating event network-vif-plugged:7926b647-0ec9-46fb-9fed-f33f2ff9fbcf for instance 1c74fb45-ef8a-4a88-8126-21c8266fddb2 on hv-cinder-maste Oct 19 00:40:27.240134 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-aead3c4d-37c2-4a2c-bd6f-4649c45fa4bc req-07a6e10d-09de-44e2-a712-7aaa68604f0b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087540 Oct 19 00:40:27.243005 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 59/104] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:40:27.244824 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 46/105] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:27 2022] GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804 => generated 1217 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:27.252814 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-228bc8ba-49a0-47b6-92d0-bc1cee55c422 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:27.254037 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-228bc8ba-49a0-47b6-92d0-bc1cee55c422 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:27.266599 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-228bc8ba-49a0-47b6-92d0-bc1cee55c422 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:27.267170 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-228bc8ba-49a0-47b6-92d0-bc1cee55c422 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:27.267495 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-228bc8ba-49a0-47b6-92d0-bc1cee55c422 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:27.268431 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-228bc8ba-49a0-47b6-92d0-bc1cee55c422 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:27.269171 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-228bc8ba-49a0-47b6-92d0-bc1cee55c422 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:27.269595 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-228bc8ba-49a0-47b6-92d0-bc1cee55c422 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:27.394167 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-c490796a-6dfb-4367-9f2d-60ed7d582de7 req-d99dea1c-c370-4b3e-bf15-fd3784a23ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f550e071-b7cd-4628-aff9-59e09cfcd654", "tag": "11a76c21-a751-4ca5-acc2-a510feda4607"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:40:27.403706 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-c490796a-6dfb-4367-9f2d-60ed7d582de7 req-d99dea1c-c370-4b3e-bf15-fd3784a23ad1 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:27.404774 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-c490796a-6dfb-4367-9f2d-60ed7d582de7 req-d99dea1c-c370-4b3e-bf15-fd3784a23ad1 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:27.405458 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-c490796a-6dfb-4367-9f2d-60ed7d582de7 req-d99dea1c-c370-4b3e-bf15-fd3784a23ad1 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:27.409725 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell1:SELECT=100 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:27.418812 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-c490796a-6dfb-4367-9f2d-60ed7d582de7 req-d99dea1c-c370-4b3e-bf15-fd3784a23ad1 service nova] Creating event network-changed:11a76c21-a751-4ca5-acc2-a510feda4607 for instance f550e071-b7cd-4628-aff9-59e09cfcd654 on hv-cinder-maste Oct 19 00:40:27.427596 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-c490796a-6dfb-4367-9f2d-60ed7d582de7 req-d99dea1c-c370-4b3e-bf15-fd3784a23ad1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036947 Oct 19 00:40:27.433693 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 47/106] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:40:27.494847 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-228bc8ba-49a0-47b6-92d0-bc1cee55c422 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:27.504382 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-228bc8ba-49a0-47b6-92d0-bc1cee55c422 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:27.505831 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-228bc8ba-49a0-47b6-92d0-bc1cee55c422 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:27.506938 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-228bc8ba-49a0-47b6-92d0-bc1cee55c422 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1407 microversion: 2.20 time: 0.261461 Oct 19 00:40:27.507477 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 60/107] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:40:27 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:40:27.597107 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-169ccd3e-3404-4fb1-92ee-35f8391b28e9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:27.597810 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-169ccd3e-3404-4fb1-92ee-35f8391b28e9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:27.603794 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-169ccd3e-3404-4fb1-92ee-35f8391b28e9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:27.604317 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-169ccd3e-3404-4fb1-92ee-35f8391b28e9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:27.604750 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-169ccd3e-3404-4fb1-92ee-35f8391b28e9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:27.605443 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-169ccd3e-3404-4fb1-92ee-35f8391b28e9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:27.605897 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-169ccd3e-3404-4fb1-92ee-35f8391b28e9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:27.606317 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-169ccd3e-3404-4fb1-92ee-35f8391b28e9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:27.748983 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-169ccd3e-3404-4fb1-92ee-35f8391b28e9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:27.750174 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-dcb48558-1f47-4a7b-81d0-9dc48148c297 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:27.750851 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-dcb48558-1f47-4a7b-81d0-9dc48148c297 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:27.758573 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-169ccd3e-3404-4fb1-92ee-35f8391b28e9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1321 microversion: 2.1 time: 0.164665 Oct 19 00:40:27.759245 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 48/108] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:27 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:27.764794 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dcb48558-1f47-4a7b-81d0-9dc48148c297 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:27.765292 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dcb48558-1f47-4a7b-81d0-9dc48148c297 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:27.765724 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dcb48558-1f47-4a7b-81d0-9dc48148c297 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:27.766598 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dcb48558-1f47-4a7b-81d0-9dc48148c297 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:27.767298 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dcb48558-1f47-4a7b-81d0-9dc48148c297 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:27.767889 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dcb48558-1f47-4a7b-81d0-9dc48148c297 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:27.956630 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-dcb48558-1f47-4a7b-81d0-9dc48148c297 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:27.965071 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-dcb48558-1f47-4a7b-81d0-9dc48148c297 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1364 microversion: 2.1 time: 0.219030 Oct 19 00:40:27.965717 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 61/109] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:27 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1364 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:40:28.051537 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-704b2554-848d-44b9-aff9-cff56344d10a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:28.052186 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-704b2554-848d-44b9-aff9-cff56344d10a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 361dfd3b-f488-4dac-9511-f28c93f74d37] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:28.058997 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-704b2554-848d-44b9-aff9-cff56344d10a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:28.059487 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-704b2554-848d-44b9-aff9-cff56344d10a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:28.059970 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-704b2554-848d-44b9-aff9-cff56344d10a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:28.070792 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-704b2554-848d-44b9-aff9-cff56344d10a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:28.072799 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-704b2554-848d-44b9-aff9-cff56344d10a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:28.073263 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-704b2554-848d-44b9-aff9-cff56344d10a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:28.170972 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-17e9ac6d-d6ae-4095-a1d8-d05e98dab59e tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:28.171552 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-17e9ac6d-d6ae-4095-a1d8-d05e98dab59e tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:28.179746 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-17e9ac6d-d6ae-4095-a1d8-d05e98dab59e tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:28.180503 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-17e9ac6d-d6ae-4095-a1d8-d05e98dab59e tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:28.181095 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-17e9ac6d-d6ae-4095-a1d8-d05e98dab59e tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:28.182383 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-17e9ac6d-d6ae-4095-a1d8-d05e98dab59e tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:28.182988 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-17e9ac6d-d6ae-4095-a1d8-d05e98dab59e tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:28.183587 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-17e9ac6d-d6ae-4095-a1d8-d05e98dab59e tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:28.922631 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-704b2554-848d-44b9-aff9-cff56344d10a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:28.933144 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-704b2554-848d-44b9-aff9-cff56344d10a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37" status: 200 len: 1366 microversion: 2.1 time: 0.885482 Oct 19 00:40:28.945008 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 49/110] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:28 2022] GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37 => generated 1366 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:28.956759 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-86299540-6a3d-4306-84c0-4ecb45e7c397 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:28.957692 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-86299540-6a3d-4306-84c0-4ecb45e7c397 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] [instance: 27c84340-8c49-4f3f-8c36-eb1a2cdaa804] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:28.965336 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-86299540-6a3d-4306-84c0-4ecb45e7c397 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:28.966091 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-86299540-6a3d-4306-84c0-4ecb45e7c397 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:28.967249 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-86299540-6a3d-4306-84c0-4ecb45e7c397 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:28.968433 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-86299540-6a3d-4306-84c0-4ecb45e7c397 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:28.969070 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-86299540-6a3d-4306-84c0-4ecb45e7c397 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:28.969770 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-86299540-6a3d-4306-84c0-4ecb45e7c397 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:29.100170 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-17e9ac6d-d6ae-4095-a1d8-d05e98dab59e tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda9dd9eb8d3446c96b0c702dd09d2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb46376a666496b896ad085315c58fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:29.109733 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-17e9ac6d-d6ae-4095-a1d8-d05e98dab59e tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641" status: 200 len: 1315 microversion: 2.1 time: 0.942733 Oct 19 00:40:29.110818 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 62/111] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:28 2022] GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 => generated 1315 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:40:29.116301 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-85c32ea8-e290-41cf-be6d-0128b5836cc3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:29.117242 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-85c32ea8-e290-41cf-be6d-0128b5836cc3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:29.117855 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-86299540-6a3d-4306-84c0-4ecb45e7c397 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e5b2b9d844730bf0c955c1c47b582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78099a2acb31422095531592b7c2da20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:29.124916 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-85c32ea8-e290-41cf-be6d-0128b5836cc3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:29.125790 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-85c32ea8-e290-41cf-be6d-0128b5836cc3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:29.126391 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-85c32ea8-e290-41cf-be6d-0128b5836cc3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:29.127097 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-85c32ea8-e290-41cf-be6d-0128b5836cc3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:29.127809 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-85c32ea8-e290-41cf-be6d-0128b5836cc3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:29.128026 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-85c32ea8-e290-41cf-be6d-0128b5836cc3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:29.136406 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-86299540-6a3d-4306-84c0-4ecb45e7c397 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] 10.222.0.33 "GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804" status: 200 len: 1265 microversion: 2.1 time: 0.185045 Oct 19 00:40:29.138005 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 50/112] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:28 2022] GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:29.144591 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-62159e13-456d-4bc9-9d7a-ea84c6c645ce tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:29.146142 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-62159e13-456d-4bc9-9d7a-ea84c6c645ce tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:29.177630 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-62159e13-456d-4bc9-9d7a-ea84c6c645ce tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:29.178608 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-62159e13-456d-4bc9-9d7a-ea84c6c645ce tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:29.179646 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-62159e13-456d-4bc9-9d7a-ea84c6c645ce tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:29.180582 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-62159e13-456d-4bc9-9d7a-ea84c6c645ce tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:29.181249 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-62159e13-456d-4bc9-9d7a-ea84c6c645ce tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:29.181824 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-62159e13-456d-4bc9-9d7a-ea84c6c645ce tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:29.294487 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-85c32ea8-e290-41cf-be6d-0128b5836cc3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:29.303612 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-85c32ea8-e290-41cf-be6d-0128b5836cc3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:29.305392 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-85c32ea8-e290-41cf-be6d-0128b5836cc3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:29.306597 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-85c32ea8-e290-41cf-be6d-0128b5836cc3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1407 microversion: 2.20 time: 0.194641 Oct 19 00:40:29.307474 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 63/113] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:40:29 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:40:29.313866 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-5576f638-40ed-4314-acef-d54f476e5301 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:29.314696 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-5576f638-40ed-4314-acef-d54f476e5301 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:29.323025 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5576f638-40ed-4314-acef-d54f476e5301 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:29.323971 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5576f638-40ed-4314-acef-d54f476e5301 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:29.325061 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5576f638-40ed-4314-acef-d54f476e5301 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:29.326505 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5576f638-40ed-4314-acef-d54f476e5301 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:29.327190 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5576f638-40ed-4314-acef-d54f476e5301 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:29.328409 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5576f638-40ed-4314-acef-d54f476e5301 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:29.470817 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-5576f638-40ed-4314-acef-d54f476e5301 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:29.479089 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-5576f638-40ed-4314-acef-d54f476e5301 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1364 microversion: 2.1 time: 0.169753 Oct 19 00:40:29.479663 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 64/114] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:29 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:29.492521 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-95a0f213-61b5-4138-89d0-ccd888a43db6 req-0ef362a8-00bc-4a56-8caf-72e7e4773970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4389c416-28bf-4b8e-945e-386f38c16859", "name": "network-vif-plugged", "status": "completed", "tag": "aaf9d032-091b-4318-8721-bd06e12204aa"}]} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:40:29.496289 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-95a0f213-61b5-4138-89d0-ccd888a43db6 req-0ef362a8-00bc-4a56-8caf-72e7e4773970 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:29.496749 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-95a0f213-61b5-4138-89d0-ccd888a43db6 req-0ef362a8-00bc-4a56-8caf-72e7e4773970 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:29.497215 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-95a0f213-61b5-4138-89d0-ccd888a43db6 req-0ef362a8-00bc-4a56-8caf-72e7e4773970 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:29.508645 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.compute.server_external_events [req-95a0f213-61b5-4138-89d0-ccd888a43db6 req-0ef362a8-00bc-4a56-8caf-72e7e4773970 service nova] Creating event network-vif-plugged:aaf9d032-091b-4318-8721-bd06e12204aa for instance 4389c416-28bf-4b8e-945e-386f38c16859 on hv-cinder-maste Oct 19 00:40:29.513524 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-95a0f213-61b5-4138-89d0-ccd888a43db6 req-0ef362a8-00bc-4a56-8caf-72e7e4773970 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032607 Oct 19 00:40:29.514114 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 65/115] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:40:29.521941 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-62159e13-456d-4bc9-9d7a-ea84c6c645ce tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:29.530585 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-62159e13-456d-4bc9-9d7a-ea84c6c645ce tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1321 microversion: 2.1 time: 0.391212 Oct 19 00:40:29.531185 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 51/116] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:29 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1321 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:29.959436 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-b9542133-3ca9-4208-8978-9ab043d9ed86 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:29.961397 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-b9542133-3ca9-4208-8978-9ab043d9ed86 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 361dfd3b-f488-4dac-9511-f28c93f74d37] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:29.969116 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b9542133-3ca9-4208-8978-9ab043d9ed86 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:29.969812 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b9542133-3ca9-4208-8978-9ab043d9ed86 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:29.970526 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b9542133-3ca9-4208-8978-9ab043d9ed86 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:29.971225 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b9542133-3ca9-4208-8978-9ab043d9ed86 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:29.972000 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b9542133-3ca9-4208-8978-9ab043d9ed86 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:29.972569 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b9542133-3ca9-4208-8978-9ab043d9ed86 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:30.135774 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-a67704f9-e04d-4a57-98a3-211768cbba7a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:30.137482 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-a67704f9-e04d-4a57-98a3-211768cbba7a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:30.146051 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a67704f9-e04d-4a57-98a3-211768cbba7a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:30.146551 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a67704f9-e04d-4a57-98a3-211768cbba7a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:30.147119 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a67704f9-e04d-4a57-98a3-211768cbba7a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:30.148034 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a67704f9-e04d-4a57-98a3-211768cbba7a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:30.148484 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a67704f9-e04d-4a57-98a3-211768cbba7a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:30.149087 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a67704f9-e04d-4a57-98a3-211768cbba7a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:30.161835 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-b9542133-3ca9-4208-8978-9ab043d9ed86 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:30.170893 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-b9542133-3ca9-4208-8978-9ab043d9ed86 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37" status: 200 len: 1366 microversion: 2.1 time: 0.215065 Oct 19 00:40:30.173503 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 66/117] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:29 2022] GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:30.178575 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-43dd8e3e-5cab-4650-b469-ce4f4a02a6a4 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:30.179333 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-43dd8e3e-5cab-4650-b469-ce4f4a02a6a4 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] [instance: 27c84340-8c49-4f3f-8c36-eb1a2cdaa804] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:30.185982 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-43dd8e3e-5cab-4650-b469-ce4f4a02a6a4 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:30.186469 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-43dd8e3e-5cab-4650-b469-ce4f4a02a6a4 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:30.186902 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-43dd8e3e-5cab-4650-b469-ce4f4a02a6a4 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:30.187599 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-43dd8e3e-5cab-4650-b469-ce4f4a02a6a4 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:30.188199 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-43dd8e3e-5cab-4650-b469-ce4f4a02a6a4 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:30.188624 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-43dd8e3e-5cab-4650-b469-ce4f4a02a6a4 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:30.296208 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-43dd8e3e-5cab-4650-b469-ce4f4a02a6a4 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e5b2b9d844730bf0c955c1c47b582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78099a2acb31422095531592b7c2da20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:30.312335 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-43dd8e3e-5cab-4650-b469-ce4f4a02a6a4 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] 10.222.0.33 "GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804" status: 200 len: 1265 microversion: 2.1 time: 0.137517 Oct 19 00:40:30.313053 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 67/118] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:30 2022] GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804 => generated 1265 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:30.324198 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-a67704f9-e04d-4a57-98a3-211768cbba7a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda9dd9eb8d3446c96b0c702dd09d2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb46376a666496b896ad085315c58fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:30.334235 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-a67704f9-e04d-4a57-98a3-211768cbba7a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641" status: 200 len: 1315 microversion: 2.1 time: 0.203914 Oct 19 00:40:30.347950 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-58d63ecd-141e-4a31-858d-f965c673cd01 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:30.347950 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-58d63ecd-141e-4a31-858d-f965c673cd01 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:30.347950 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-58d63ecd-141e-4a31-858d-f965c673cd01 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:30.347950 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-58d63ecd-141e-4a31-858d-f965c673cd01 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:30.348506 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-58d63ecd-141e-4a31-858d-f965c673cd01 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:30.348506 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-58d63ecd-141e-4a31-858d-f965c673cd01 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:30.348506 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-58d63ecd-141e-4a31-858d-f965c673cd01 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:30.348764 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-58d63ecd-141e-4a31-858d-f965c673cd01 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:30.350391 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 52/119] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:30 2022] GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:40:30.504360 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-cb79aec8-9554-4437-b7dc-264e933f1a4e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:30.505199 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-cb79aec8-9554-4437-b7dc-264e933f1a4e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:30.512042 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cb79aec8-9554-4437-b7dc-264e933f1a4e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:30.512331 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cb79aec8-9554-4437-b7dc-264e933f1a4e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:30.512704 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cb79aec8-9554-4437-b7dc-264e933f1a4e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:30.513467 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cb79aec8-9554-4437-b7dc-264e933f1a4e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:30.513921 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cb79aec8-9554-4437-b7dc-264e933f1a4e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:30.514503 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cb79aec8-9554-4437-b7dc-264e933f1a4e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:30.527607 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-58d63ecd-141e-4a31-858d-f965c673cd01 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:30.538337 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-58d63ecd-141e-4a31-858d-f965c673cd01 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:30.540157 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-58d63ecd-141e-4a31-858d-f965c673cd01 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:30.549935 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-58d63ecd-141e-4a31-858d-f965c673cd01 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1407 microversion: 2.20 time: 0.217269 Oct 19 00:40:30.551353 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 68/120] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:40:30 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:40:30.560124 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-a73349d0-b27e-4dd0-b1e0-f80a9a4228ff tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:30.560124 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-a73349d0-b27e-4dd0-b1e0-f80a9a4228ff tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:30.564282 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a73349d0-b27e-4dd0-b1e0-f80a9a4228ff tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:30.564943 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a73349d0-b27e-4dd0-b1e0-f80a9a4228ff tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:30.575341 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a73349d0-b27e-4dd0-b1e0-f80a9a4228ff tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:30.577191 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a73349d0-b27e-4dd0-b1e0-f80a9a4228ff tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:30.579476 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a73349d0-b27e-4dd0-b1e0-f80a9a4228ff tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:30.580477 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a73349d0-b27e-4dd0-b1e0-f80a9a4228ff tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:30.700067 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-cb79aec8-9554-4437-b7dc-264e933f1a4e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:30.722482 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-cb79aec8-9554-4437-b7dc-264e933f1a4e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1364 microversion: 2.1 time: 0.222498 Oct 19 00:40:30.723067 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 53/121] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:30 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1364 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:30.774565 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-a73349d0-b27e-4dd0-b1e0-f80a9a4228ff tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:30.784533 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-a73349d0-b27e-4dd0-b1e0-f80a9a4228ff tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1321 microversion: 2.1 time: 0.231899 Oct 19 00:40:30.786329 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 69/122] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:30 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:31.195248 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-0a650383-d64b-49e6-8c1f-f47704c34b10 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:31.196428 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-0a650383-d64b-49e6-8c1f-f47704c34b10 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 361dfd3b-f488-4dac-9511-f28c93f74d37] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:31.204621 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0a650383-d64b-49e6-8c1f-f47704c34b10 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:31.205314 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0a650383-d64b-49e6-8c1f-f47704c34b10 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:31.206177 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0a650383-d64b-49e6-8c1f-f47704c34b10 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:31.207107 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0a650383-d64b-49e6-8c1f-f47704c34b10 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:31.208119 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0a650383-d64b-49e6-8c1f-f47704c34b10 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:31.208718 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0a650383-d64b-49e6-8c1f-f47704c34b10 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:31.335795 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-9ee9a51c-4471-4753-ba0b-9559d6e452e1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:31.336436 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-9ee9a51c-4471-4753-ba0b-9559d6e452e1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] [instance: 27c84340-8c49-4f3f-8c36-eb1a2cdaa804] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:31.342706 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9ee9a51c-4471-4753-ba0b-9559d6e452e1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:31.343191 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9ee9a51c-4471-4753-ba0b-9559d6e452e1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:31.343627 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9ee9a51c-4471-4753-ba0b-9559d6e452e1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:31.344356 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9ee9a51c-4471-4753-ba0b-9559d6e452e1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:31.344813 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9ee9a51c-4471-4753-ba0b-9559d6e452e1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:31.345242 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9ee9a51c-4471-4753-ba0b-9559d6e452e1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:31.413839 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-9ee9a51c-4471-4753-ba0b-9559d6e452e1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e5b2b9d844730bf0c955c1c47b582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78099a2acb31422095531592b7c2da20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:31.424566 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-0a650383-d64b-49e6-8c1f-f47704c34b10 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:31.436479 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-0a650383-d64b-49e6-8c1f-f47704c34b10 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37" status: 200 len: 1366 microversion: 2.1 time: 0.244580 Oct 19 00:40:31.437345 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 54/123] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:31 2022] GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37 => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:40:31.440318 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-9ee9a51c-4471-4753-ba0b-9559d6e452e1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] 10.222.0.33 "GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804" status: 200 len: 1265 microversion: 2.1 time: 0.108362 Oct 19 00:40:31.442832 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-31d6f69e-cb79-4511-b3cf-e3779dbd81fe tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:31.443661 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-31d6f69e-cb79-4511-b3cf-e3779dbd81fe tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:31.449583 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-31d6f69e-cb79-4511-b3cf-e3779dbd81fe tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:31.450405 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-31d6f69e-cb79-4511-b3cf-e3779dbd81fe tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:31.451247 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-31d6f69e-cb79-4511-b3cf-e3779dbd81fe tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:31.452718 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-31d6f69e-cb79-4511-b3cf-e3779dbd81fe tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:31.453489 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-31d6f69e-cb79-4511-b3cf-e3779dbd81fe tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:31.454120 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-31d6f69e-cb79-4511-b3cf-e3779dbd81fe tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:31.458583 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 70/124] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:31 2022] GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804 => generated 1265 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:31.577780 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-96f43d36-05fc-4894-adcb-8d5447d62a80 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:31.578483 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-96f43d36-05fc-4894-adcb-8d5447d62a80 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:31.591760 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-96f43d36-05fc-4894-adcb-8d5447d62a80 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:31.592952 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-96f43d36-05fc-4894-adcb-8d5447d62a80 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:31.593493 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-96f43d36-05fc-4894-adcb-8d5447d62a80 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:31.594275 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-96f43d36-05fc-4894-adcb-8d5447d62a80 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:31.594895 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-96f43d36-05fc-4894-adcb-8d5447d62a80 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:31.595389 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-96f43d36-05fc-4894-adcb-8d5447d62a80 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:31.671273 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-31d6f69e-cb79-4511-b3cf-e3779dbd81fe tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda9dd9eb8d3446c96b0c702dd09d2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb46376a666496b896ad085315c58fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:31.682060 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-31d6f69e-cb79-4511-b3cf-e3779dbd81fe tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641" status: 200 len: 1315 microversion: 2.1 time: 0.243335 Oct 19 00:40:31.686044 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 55/125] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:31 2022] GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:31.749170 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-0d9e2f8d-2ede-4f04-ad33-6ee30eeaf1a6 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:31.749699 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-0d9e2f8d-2ede-4f04-ad33-6ee30eeaf1a6 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:31.756659 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0d9e2f8d-2ede-4f04-ad33-6ee30eeaf1a6 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:31.757137 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0d9e2f8d-2ede-4f04-ad33-6ee30eeaf1a6 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:31.757564 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0d9e2f8d-2ede-4f04-ad33-6ee30eeaf1a6 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:31.758251 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0d9e2f8d-2ede-4f04-ad33-6ee30eeaf1a6 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:31.758690 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0d9e2f8d-2ede-4f04-ad33-6ee30eeaf1a6 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:31.759294 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0d9e2f8d-2ede-4f04-ad33-6ee30eeaf1a6 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:31.807297 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-96f43d36-05fc-4894-adcb-8d5447d62a80 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:31.820279 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-96f43d36-05fc-4894-adcb-8d5447d62a80 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:31.821724 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-96f43d36-05fc-4894-adcb-8d5447d62a80 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:31.822842 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-96f43d36-05fc-4894-adcb-8d5447d62a80 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1407 microversion: 2.20 time: 0.249454 Oct 19 00:40:31.823826 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 71/126] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:40:31 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:40:31.828691 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-a087a3fb-de31-4053-a9dd-a835a9592b6e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:31.829439 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-a087a3fb-de31-4053-a9dd-a835a9592b6e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:31.836453 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a087a3fb-de31-4053-a9dd-a835a9592b6e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:31.837899 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a087a3fb-de31-4053-a9dd-a835a9592b6e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:31.838679 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a087a3fb-de31-4053-a9dd-a835a9592b6e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:31.840190 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a087a3fb-de31-4053-a9dd-a835a9592b6e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:31.840828 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a087a3fb-de31-4053-a9dd-a835a9592b6e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:31.841939 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a087a3fb-de31-4053-a9dd-a835a9592b6e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:31.921598 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-0d9e2f8d-2ede-4f04-ad33-6ee30eeaf1a6 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:31.931714 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-0d9e2f8d-2ede-4f04-ad33-6ee30eeaf1a6 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1364 microversion: 2.1 time: 0.186985 Oct 19 00:40:31.932919 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 56/127] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:31 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1364 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:32.018794 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-a087a3fb-de31-4053-a9dd-a835a9592b6e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:32.026796 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-a087a3fb-de31-4053-a9dd-a835a9592b6e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1321 microversion: 2.1 time: 0.201954 Oct 19 00:40:32.027364 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 72/128] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:31 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:32.468256 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-cc6e1edf-1c78-423c-88f9-9f40a543d027 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:32.468876 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-cc6e1edf-1c78-423c-88f9-9f40a543d027 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] [instance: 27c84340-8c49-4f3f-8c36-eb1a2cdaa804] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:32.469898 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-a15f1489-ba64-4335-ad3d-3b2626e6cc9b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:32.471521 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-a15f1489-ba64-4335-ad3d-3b2626e6cc9b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 361dfd3b-f488-4dac-9511-f28c93f74d37] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:32.488239 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a15f1489-ba64-4335-ad3d-3b2626e6cc9b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:32.488956 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cc6e1edf-1c78-423c-88f9-9f40a543d027 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:32.489671 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cc6e1edf-1c78-423c-88f9-9f40a543d027 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:32.490293 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cc6e1edf-1c78-423c-88f9-9f40a543d027 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:32.490981 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a15f1489-ba64-4335-ad3d-3b2626e6cc9b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:32.492471 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a15f1489-ba64-4335-ad3d-3b2626e6cc9b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:32.492971 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cc6e1edf-1c78-423c-88f9-9f40a543d027 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:32.494120 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cc6e1edf-1c78-423c-88f9-9f40a543d027 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:32.495595 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cc6e1edf-1c78-423c-88f9-9f40a543d027 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:32.496064 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a15f1489-ba64-4335-ad3d-3b2626e6cc9b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:32.496664 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a15f1489-ba64-4335-ad3d-3b2626e6cc9b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:32.497098 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a15f1489-ba64-4335-ad3d-3b2626e6cc9b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:32.684006 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-cc6e1edf-1c78-423c-88f9-9f40a543d027 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e5b2b9d844730bf0c955c1c47b582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78099a2acb31422095531592b7c2da20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:32.695679 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-cc6e1edf-1c78-423c-88f9-9f40a543d027 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] 10.222.0.33 "GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804" status: 200 len: 1265 microversion: 2.1 time: 0.236258 Oct 19 00:40:32.697006 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 73/129] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:32 2022] GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804 => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:32.708669 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-a15f1489-ba64-4335-ad3d-3b2626e6cc9b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:32.720632 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-dc4bea7f-0348-424e-8af7-6882b6d29a33 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:32.721450 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-dc4bea7f-0348-424e-8af7-6882b6d29a33 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:32.722160 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-a15f1489-ba64-4335-ad3d-3b2626e6cc9b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37" status: 200 len: 1366 microversion: 2.1 time: 0.265414 Oct 19 00:40:32.723508 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 57/130] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:32 2022] GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37 => generated 1366 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:32.733488 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dc4bea7f-0348-424e-8af7-6882b6d29a33 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:32.734364 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dc4bea7f-0348-424e-8af7-6882b6d29a33 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:32.735204 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dc4bea7f-0348-424e-8af7-6882b6d29a33 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:32.736124 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dc4bea7f-0348-424e-8af7-6882b6d29a33 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:32.742127 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dc4bea7f-0348-424e-8af7-6882b6d29a33 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:32.742844 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dc4bea7f-0348-424e-8af7-6882b6d29a33 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:32.754710 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell1:SELECT=100 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:32.850395 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-cac0d0db-01e3-478f-8827-15ff7642bf50 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:32.850989 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-cac0d0db-01e3-478f-8827-15ff7642bf50 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:32.862406 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cac0d0db-01e3-478f-8827-15ff7642bf50 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:32.863703 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cac0d0db-01e3-478f-8827-15ff7642bf50 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:32.865308 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cac0d0db-01e3-478f-8827-15ff7642bf50 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:32.868561 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cac0d0db-01e3-478f-8827-15ff7642bf50 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:32.869225 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cac0d0db-01e3-478f-8827-15ff7642bf50 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:32.869969 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cac0d0db-01e3-478f-8827-15ff7642bf50 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:33.086417 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-dc4bea7f-0348-424e-8af7-6882b6d29a33 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda9dd9eb8d3446c96b0c702dd09d2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb46376a666496b896ad085315c58fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:33.100877 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-dc4bea7f-0348-424e-8af7-6882b6d29a33 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641" status: 200 len: 1315 microversion: 2.1 time: 0.387097 Oct 19 00:40:33.102298 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 74/131] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:32 2022] GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:33.110272 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-f9aee6b4-4a5b-4fe8-b840-d4fb43a72c58 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:33.112618 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-f9aee6b4-4a5b-4fe8-b840-d4fb43a72c58 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:33.116900 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-cac0d0db-01e3-478f-8827-15ff7642bf50 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:33.131504 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f9aee6b4-4a5b-4fe8-b840-d4fb43a72c58 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:33.132236 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-cac0d0db-01e3-478f-8827-15ff7642bf50 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:33.133867 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-cac0d0db-01e3-478f-8827-15ff7642bf50 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:33.138387 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f9aee6b4-4a5b-4fe8-b840-d4fb43a72c58 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:33.140921 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f9aee6b4-4a5b-4fe8-b840-d4fb43a72c58 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:33.141835 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f9aee6b4-4a5b-4fe8-b840-d4fb43a72c58 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:33.142626 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f9aee6b4-4a5b-4fe8-b840-d4fb43a72c58 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:33.144196 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f9aee6b4-4a5b-4fe8-b840-d4fb43a72c58 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:33.148848 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-cac0d0db-01e3-478f-8827-15ff7642bf50 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1407 microversion: 2.20 time: 0.288808 Oct 19 00:40:33.150115 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 58/132] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:40:32 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1407 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:40:33.156587 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-bdfe0a60-8fa3-4d06-ba97-91f6a9e80fc0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:33.157933 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-bdfe0a60-8fa3-4d06-ba97-91f6a9e80fc0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:33.165714 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bdfe0a60-8fa3-4d06-ba97-91f6a9e80fc0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:33.166374 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bdfe0a60-8fa3-4d06-ba97-91f6a9e80fc0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:33.167021 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bdfe0a60-8fa3-4d06-ba97-91f6a9e80fc0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:33.167879 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bdfe0a60-8fa3-4d06-ba97-91f6a9e80fc0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:33.168579 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bdfe0a60-8fa3-4d06-ba97-91f6a9e80fc0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:33.169194 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bdfe0a60-8fa3-4d06-ba97-91f6a9e80fc0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:33.350025 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-f9aee6b4-4a5b-4fe8-b840-d4fb43a72c58 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:33.358350 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-f9aee6b4-4a5b-4fe8-b840-d4fb43a72c58 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1364 microversion: 2.1 time: 0.254813 Oct 19 00:40:33.359061 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 75/133] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:33 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1364 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:33.363697 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-ef5c40fc-59e5-430d-9a2b-eabec5805490 req-08732708-706c-4e33-97f8-21763e497933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "361dfd3b-f488-4dac-9511-f28c93f74d37", "name": "network-vif-plugged", "status": "completed", "tag": "579ced1d-44c1-46ae-bffb-7e11769e3f01"}]} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:40:33.374355 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-ef5c40fc-59e5-430d-9a2b-eabec5805490 req-08732708-706c-4e33-97f8-21763e497933 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:33.374835 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-ef5c40fc-59e5-430d-9a2b-eabec5805490 req-08732708-706c-4e33-97f8-21763e497933 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:33.375263 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-ef5c40fc-59e5-430d-9a2b-eabec5805490 req-08732708-706c-4e33-97f8-21763e497933 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:33.382259 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-bdfe0a60-8fa3-4d06-ba97-91f6a9e80fc0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:33.386959 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.compute.server_external_events [req-ef5c40fc-59e5-430d-9a2b-eabec5805490 req-08732708-706c-4e33-97f8-21763e497933 service nova] Creating event network-vif-plugged:579ced1d-44c1-46ae-bffb-7e11769e3f01 for instance 361dfd3b-f488-4dac-9511-f28c93f74d37 on hv-cinder-maste Oct 19 00:40:33.391421 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-bdfe0a60-8fa3-4d06-ba97-91f6a9e80fc0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1321 microversion: 2.1 time: 0.239497 Oct 19 00:40:33.392365 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 59/134] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:33 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1321 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:33.393034 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-ef5c40fc-59e5-430d-9a2b-eabec5805490 req-08732708-706c-4e33-97f8-21763e497933 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032505 Oct 19 00:40:33.393846 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 76/135] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:40:33.724190 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-e14d393b-d24e-498b-81f6-fde2698f5f2d tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:33.724805 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-e14d393b-d24e-498b-81f6-fde2698f5f2d tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] [instance: 27c84340-8c49-4f3f-8c36-eb1a2cdaa804] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:33.733084 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e14d393b-d24e-498b-81f6-fde2698f5f2d tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:33.733576 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e14d393b-d24e-498b-81f6-fde2698f5f2d tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:33.736113 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e14d393b-d24e-498b-81f6-fde2698f5f2d tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:33.738198 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e14d393b-d24e-498b-81f6-fde2698f5f2d tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:33.739099 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e14d393b-d24e-498b-81f6-fde2698f5f2d tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:33.740283 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e14d393b-d24e-498b-81f6-fde2698f5f2d tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:33.750148 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-95a7ec4b-d304-4e02-8a5e-fbb33c9b4f75 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:33.750867 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-95a7ec4b-d304-4e02-8a5e-fbb33c9b4f75 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 361dfd3b-f488-4dac-9511-f28c93f74d37] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:33.758371 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-95a7ec4b-d304-4e02-8a5e-fbb33c9b4f75 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:33.759227 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-95a7ec4b-d304-4e02-8a5e-fbb33c9b4f75 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:33.759872 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-95a7ec4b-d304-4e02-8a5e-fbb33c9b4f75 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:33.760788 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-95a7ec4b-d304-4e02-8a5e-fbb33c9b4f75 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:33.761425 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-95a7ec4b-d304-4e02-8a5e-fbb33c9b4f75 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:33.762170 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-95a7ec4b-d304-4e02-8a5e-fbb33c9b4f75 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:33.852589 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-e14d393b-d24e-498b-81f6-fde2698f5f2d tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e5b2b9d844730bf0c955c1c47b582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78099a2acb31422095531592b7c2da20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:33.869943 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-e14d393b-d24e-498b-81f6-fde2698f5f2d tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] 10.222.0.33 "GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804" status: 200 len: 1273 microversion: 2.1 time: 0.147365 Oct 19 00:40:33.871967 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 60/136] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:33 2022] GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804 => generated 1273 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:34.014927 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-95a7ec4b-d304-4e02-8a5e-fbb33c9b4f75 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:34.022844 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-95a7ec4b-d304-4e02-8a5e-fbb33c9b4f75 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37" status: 200 len: 1366 microversion: 2.1 time: 0.278111 Oct 19 00:40:34.023407 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 77/137] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:33 2022] GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37 => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:34.131893 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-d6136102-4986-43ce-a0ea-75f75385fc90 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:34.132519 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-d6136102-4986-43ce-a0ea-75f75385fc90 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:34.138442 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d6136102-4986-43ce-a0ea-75f75385fc90 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:34.139488 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d6136102-4986-43ce-a0ea-75f75385fc90 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:34.139944 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d6136102-4986-43ce-a0ea-75f75385fc90 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:34.140628 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d6136102-4986-43ce-a0ea-75f75385fc90 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:34.141078 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d6136102-4986-43ce-a0ea-75f75385fc90 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:34.141490 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d6136102-4986-43ce-a0ea-75f75385fc90 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:34.177981 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-2305b7a7-5a0e-43aa-bb9c-89dc2001a57e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:34.178610 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-2305b7a7-5a0e-43aa-bb9c-89dc2001a57e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:34.210258 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2305b7a7-5a0e-43aa-bb9c-89dc2001a57e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:34.210786 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2305b7a7-5a0e-43aa-bb9c-89dc2001a57e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:34.212110 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2305b7a7-5a0e-43aa-bb9c-89dc2001a57e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:34.213235 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2305b7a7-5a0e-43aa-bb9c-89dc2001a57e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:34.214005 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2305b7a7-5a0e-43aa-bb9c-89dc2001a57e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:34.214774 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2305b7a7-5a0e-43aa-bb9c-89dc2001a57e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:34.473731 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-d6136102-4986-43ce-a0ea-75f75385fc90 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda9dd9eb8d3446c96b0c702dd09d2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb46376a666496b896ad085315c58fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:34.485094 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-d6136102-4986-43ce-a0ea-75f75385fc90 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641" status: 200 len: 1315 microversion: 2.1 time: 0.357222 Oct 19 00:40:34.485820 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 61/138] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:34 2022] GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:34.490825 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-ef12f6df-95aa-4522-a39b-f4c6ba61b2e6 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:34.491425 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-ef12f6df-95aa-4522-a39b-f4c6ba61b2e6 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:34.499092 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ef12f6df-95aa-4522-a39b-f4c6ba61b2e6 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:34.499590 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ef12f6df-95aa-4522-a39b-f4c6ba61b2e6 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:34.500743 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ef12f6df-95aa-4522-a39b-f4c6ba61b2e6 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:34.501710 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ef12f6df-95aa-4522-a39b-f4c6ba61b2e6 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:34.502647 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ef12f6df-95aa-4522-a39b-f4c6ba61b2e6 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:34.504233 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ef12f6df-95aa-4522-a39b-f4c6ba61b2e6 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:34.558079 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-2305b7a7-5a0e-43aa-bb9c-89dc2001a57e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:34.577771 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-2305b7a7-5a0e-43aa-bb9c-89dc2001a57e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:34.582240 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-2305b7a7-5a0e-43aa-bb9c-89dc2001a57e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:34.585614 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-2305b7a7-5a0e-43aa-bb9c-89dc2001a57e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1407 microversion: 2.20 time: 0.411186 Oct 19 00:40:34.590193 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 78/139] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:40:34 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1407 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:40:34.610693 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-57ea5542-9838-4257-be95-e6592cb10f3f tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1770764444", "imageRef": "d1f4abc9-3bb9-4343-9a05-53d758070c9d", "flavorRef": "452"}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:40:34.676134 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.network.neutron [None req-57ea5542-9838-4257-be95-e6592cb10f3f tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] validate_networks() for None {{(pid=125532) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:40:34.728842 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-ef12f6df-95aa-4522-a39b-f4c6ba61b2e6 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:34.737402 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-ef12f6df-95aa-4522-a39b-f4c6ba61b2e6 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1364 microversion: 2.1 time: 0.250495 Oct 19 00:40:34.738556 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 62/140] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:34 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1364 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:34.751808 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-57b1f302-96b0-4475-8aaf-639843a3285d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:34.752869 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-57b1f302-96b0-4475-8aaf-639843a3285d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:34.759628 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-57b1f302-96b0-4475-8aaf-639843a3285d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:34.760149 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-57b1f302-96b0-4475-8aaf-639843a3285d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:34.760588 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-57b1f302-96b0-4475-8aaf-639843a3285d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:34.761291 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-57b1f302-96b0-4475-8aaf-639843a3285d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:34.761748 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-57b1f302-96b0-4475-8aaf-639843a3285d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:34.762195 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-57b1f302-96b0-4475-8aaf-639843a3285d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:34.897633 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-57b1f302-96b0-4475-8aaf-639843a3285d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:34.906094 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-57b1f302-96b0-4475-8aaf-639843a3285d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1321 microversion: 2.1 time: 0.166220 Oct 19 00:40:34.906702 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 63/141] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:34 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:34.911252 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-db240a9a-ad73-49cd-b102-420092a7fbad tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:34.911887 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-db240a9a-ad73-49cd-b102-420092a7fbad tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] [instance: 27c84340-8c49-4f3f-8c36-eb1a2cdaa804] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:34.917678 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-db240a9a-ad73-49cd-b102-420092a7fbad tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:34.918164 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-db240a9a-ad73-49cd-b102-420092a7fbad tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:34.918595 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-db240a9a-ad73-49cd-b102-420092a7fbad tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:34.919285 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-db240a9a-ad73-49cd-b102-420092a7fbad tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:34.920282 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-db240a9a-ad73-49cd-b102-420092a7fbad tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:34.920872 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-db240a9a-ad73-49cd-b102-420092a7fbad tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:34.936452 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell1:SELECT=100 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:34.975719 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-57ea5542-9838-4257-be95-e6592cb10f3f tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Flavor limits 0:0:0 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:40:34.976204 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-57ea5542-9838-4257-be95-e6592cb10f3f tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Image limits 0:0:0 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:40:34.976665 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-57ea5542-9838-4257-be95-e6592cb10f3f tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Flavor pref 0:0:0 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:40:34.977253 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-57ea5542-9838-4257-be95-e6592cb10f3f tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Image pref 0:0:0 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:40:34.977665 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-57ea5542-9838-4257-be95-e6592cb10f3f tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:40:34.980790 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_api:SELECT=100 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:34.983836 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-db240a9a-ad73-49cd-b102-420092a7fbad tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e5b2b9d844730bf0c955c1c47b582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78099a2acb31422095531592b7c2da20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:34.988429 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-57ea5542-9838-4257-be95-e6592cb10f3f tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:34.988909 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-57ea5542-9838-4257-be95-e6592cb10f3f tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:34.989369 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-57ea5542-9838-4257-be95-e6592cb10f3f tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:34.990098 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-57ea5542-9838-4257-be95-e6592cb10f3f tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:34.990553 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-57ea5542-9838-4257-be95-e6592cb10f3f tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:34.990977 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-57ea5542-9838-4257-be95-e6592cb10f3f tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:34.991919 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-db240a9a-ad73-49cd-b102-420092a7fbad tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] 10.222.0.33 "GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804" status: 200 len: 1283 microversion: 2.1 time: 0.084239 Oct 19 00:40:34.992847 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 64/142] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:34 2022] GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804 => generated 1283 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:35.009953 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.quota [None req-57ea5542-9838-4257-be95-e6592cb10f3f tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Getting quotas for project aab0bf27d6c7415f9d3fc8f873a0607f. Resources: {'instances', 'cores', 'ram'} {{(pid=125532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:40:35.015182 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.quota [None req-57ea5542-9838-4257-be95-e6592cb10f3f tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Getting quotas for user 0f8ed34d4b774af4821303c98872e6e7 and project aab0bf27d6c7415f9d3fc8f873a0607f. Resources: {'instances', 'cores', 'ram'} {{(pid=125532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:40:35.025699 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-57ea5542-9838-4257-be95-e6592cb10f3f tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Going to run 1 instances... {{(pid=125532) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:40:35.028168 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-57ea5542-9838-4257-be95-e6592cb10f3f tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] [instance: da272379-872f-4ae8-b961-47c6c5a50738] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1f4abc9-3bb9-4343-9a05-53d758070c9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125532) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:40:35.047443 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-bd009ac4-b0db-4cc4-91da-bb0f894ddd00 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:35.048300 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-bd009ac4-b0db-4cc4-91da-bb0f894ddd00 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 361dfd3b-f488-4dac-9511-f28c93f74d37] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:35.055911 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bd009ac4-b0db-4cc4-91da-bb0f894ddd00 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:35.056453 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bd009ac4-b0db-4cc4-91da-bb0f894ddd00 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:35.056883 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bd009ac4-b0db-4cc4-91da-bb0f894ddd00 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:35.057570 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bd009ac4-b0db-4cc4-91da-bb0f894ddd00 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:35.058018 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bd009ac4-b0db-4cc4-91da-bb0f894ddd00 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:35.058757 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bd009ac4-b0db-4cc4-91da-bb0f894ddd00 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:35.077743 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-57ea5542-9838-4257-be95-e6592cb10f3f tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.484273 Oct 19 00:40:35.078760 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 79/143] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Oct 19 00:40:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:40:35.089140 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-57b2cca8-04de-4714-996d-40e9b63c1ca9 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:35.089746 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-57b2cca8-04de-4714-996d-40e9b63c1ca9 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] [instance: da272379-872f-4ae8-b961-47c6c5a50738] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:35.173970 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-57b2cca8-04de-4714-996d-40e9b63c1ca9 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ed34d4b774af4821303c98872e6e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab0bf27d6c7415f9d3fc8f873a0607f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:35.184663 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-57b2cca8-04de-4714-996d-40e9b63c1ca9 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] 10.222.0.33 "GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738" status: 200 len: 1215 microversion: 2.1 time: 0.098417 Oct 19 00:40:35.188644 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 80/144] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:35 2022] GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738 => generated 1215 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:40:35.333292 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-bd009ac4-b0db-4cc4-91da-bb0f894ddd00 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:35.342044 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-bd009ac4-b0db-4cc4-91da-bb0f894ddd00 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37" status: 200 len: 1366 microversion: 2.1 time: 0.299414 Oct 19 00:40:35.342680 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 65/145] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:35 2022] GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37 => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:40:35.410378 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-9337a3f4-aeba-49f8-ba8b-89e1645808a5 req-265b91ed-54af-4ca9-9d29-ee713b3ec678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "961ac14f-b764-4468-baa3-a3aa1eb26627", "name": "network-vif-plugged", "status": "completed", "tag": "0d78e5c5-2afd-4926-8fbf-05fc0868ef06"}]} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:40:35.422314 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-9337a3f4-aeba-49f8-ba8b-89e1645808a5 req-265b91ed-54af-4ca9-9d29-ee713b3ec678 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:35.423133 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-9337a3f4-aeba-49f8-ba8b-89e1645808a5 req-265b91ed-54af-4ca9-9d29-ee713b3ec678 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:35.423256 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-9337a3f4-aeba-49f8-ba8b-89e1645808a5 req-265b91ed-54af-4ca9-9d29-ee713b3ec678 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:35.435877 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.compute.server_external_events [req-9337a3f4-aeba-49f8-ba8b-89e1645808a5 req-265b91ed-54af-4ca9-9d29-ee713b3ec678 service nova] Creating event network-vif-plugged:0d78e5c5-2afd-4926-8fbf-05fc0868ef06 for instance 961ac14f-b764-4468-baa3-a3aa1eb26627 on hv-cinder-maste Oct 19 00:40:35.442012 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-9337a3f4-aeba-49f8-ba8b-89e1645808a5 req-265b91ed-54af-4ca9-9d29-ee713b3ec678 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036861 Oct 19 00:40:35.442604 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 81/146] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:40:35.509899 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-26f881f1-d504-4ca2-b401-5b747e8c2ce1 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:35.510646 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-26f881f1-d504-4ca2-b401-5b747e8c2ce1 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:35.512669 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell0:SELECT=2 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:35.514258 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell0:SELECT=6 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:35.520379 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-26f881f1-d504-4ca2-b401-5b747e8c2ce1 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:35.520863 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-26f881f1-d504-4ca2-b401-5b747e8c2ce1 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:35.521331 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-26f881f1-d504-4ca2-b401-5b747e8c2ce1 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:35.522308 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-26f881f1-d504-4ca2-b401-5b747e8c2ce1 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:35.522775 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-26f881f1-d504-4ca2-b401-5b747e8c2ce1 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:35.523618 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-26f881f1-d504-4ca2-b401-5b747e8c2ce1 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:35.664575 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-482eb73e-1aca-4bd6-ad3c-c371f94f8428 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:35.671312 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-482eb73e-1aca-4bd6-ad3c-c371f94f8428 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:35.683901 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-482eb73e-1aca-4bd6-ad3c-c371f94f8428 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:35.689283 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-482eb73e-1aca-4bd6-ad3c-c371f94f8428 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:35.690943 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-482eb73e-1aca-4bd6-ad3c-c371f94f8428 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:35.692404 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-482eb73e-1aca-4bd6-ad3c-c371f94f8428 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:35.693213 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-482eb73e-1aca-4bd6-ad3c-c371f94f8428 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:35.694823 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-482eb73e-1aca-4bd6-ad3c-c371f94f8428 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:35.759550 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-26f881f1-d504-4ca2-b401-5b747e8c2ce1 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda9dd9eb8d3446c96b0c702dd09d2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb46376a666496b896ad085315c58fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:35.769252 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-26f881f1-d504-4ca2-b401-5b747e8c2ce1 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641" status: 200 len: 1502 microversion: 2.1 time: 0.263882 Oct 19 00:40:35.769829 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 66/147] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:35 2022] GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 => generated 1502 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:35.781067 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-b9a8c305-5754-4b5d-9de2-bac3ee5236ad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:35.782148 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-b9a8c305-5754-4b5d-9de2-bac3ee5236ad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:35.785045 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:35.789514 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b9a8c305-5754-4b5d-9de2-bac3ee5236ad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:35.790563 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b9a8c305-5754-4b5d-9de2-bac3ee5236ad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:35.791200 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b9a8c305-5754-4b5d-9de2-bac3ee5236ad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:35.792707 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b9a8c305-5754-4b5d-9de2-bac3ee5236ad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:35.794021 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b9a8c305-5754-4b5d-9de2-bac3ee5236ad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:35.794709 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b9a8c305-5754-4b5d-9de2-bac3ee5236ad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:36.127695 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-b9a8c305-5754-4b5d-9de2-bac3ee5236ad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:36.147618 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-b9a8c305-5754-4b5d-9de2-bac3ee5236ad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1364 microversion: 2.1 time: 0.362961 Oct 19 00:40:36.150201 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 67/148] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:35 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1364 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:36.160143 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-6ae4936c-a295-4d1b-99fa-9b3e521e068c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:36.161675 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-6ae4936c-a295-4d1b-99fa-9b3e521e068c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:36.171743 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6ae4936c-a295-4d1b-99fa-9b3e521e068c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:36.172635 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6ae4936c-a295-4d1b-99fa-9b3e521e068c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:36.173082 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6ae4936c-a295-4d1b-99fa-9b3e521e068c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:36.173787 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6ae4936c-a295-4d1b-99fa-9b3e521e068c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:36.174399 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-482eb73e-1aca-4bd6-ad3c-c371f94f8428 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:36.174903 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6ae4936c-a295-4d1b-99fa-9b3e521e068c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:36.174903 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6ae4936c-a295-4d1b-99fa-9b3e521e068c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:36.186090 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-482eb73e-1aca-4bd6-ad3c-c371f94f8428 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:36.188016 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-482eb73e-1aca-4bd6-ad3c-c371f94f8428 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:36.189587 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-482eb73e-1aca-4bd6-ad3c-c371f94f8428 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1597 microversion: 2.20 time: 0.558763 Oct 19 00:40:36.191221 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 82/149] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:40:35 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1597 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:40:36.196614 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-78f4da92-4fb1-47b1-a7b2-84ecbcb4b9b4 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:36.197422 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-78f4da92-4fb1-47b1-a7b2-84ecbcb4b9b4 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] [instance: 27c84340-8c49-4f3f-8c36-eb1a2cdaa804] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:36.204629 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-78f4da92-4fb1-47b1-a7b2-84ecbcb4b9b4 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:36.205275 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-78f4da92-4fb1-47b1-a7b2-84ecbcb4b9b4 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:36.206013 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-78f4da92-4fb1-47b1-a7b2-84ecbcb4b9b4 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:36.207067 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-78f4da92-4fb1-47b1-a7b2-84ecbcb4b9b4 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:36.208021 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-78f4da92-4fb1-47b1-a7b2-84ecbcb4b9b4 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:36.209020 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-78f4da92-4fb1-47b1-a7b2-84ecbcb4b9b4 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:36.386145 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-78f4da92-4fb1-47b1-a7b2-84ecbcb4b9b4 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e5b2b9d844730bf0c955c1c47b582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78099a2acb31422095531592b7c2da20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:36.395345 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-78f4da92-4fb1-47b1-a7b2-84ecbcb4b9b4 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] 10.222.0.33 "GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804" status: 200 len: 1325 microversion: 2.1 time: 0.202886 Oct 19 00:40:36.396790 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 83/150] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:36 2022] GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804 => generated 1325 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:36.414894 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-6ae4936c-a295-4d1b-99fa-9b3e521e068c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:36.415071 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-71d0de86-0d64-4f4f-96a4-584642fc5825 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:36.415662 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-71d0de86-0d64-4f4f-96a4-584642fc5825 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] [instance: da272379-872f-4ae8-b961-47c6c5a50738] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:36.422400 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-71d0de86-0d64-4f4f-96a4-584642fc5825 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:36.422888 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-71d0de86-0d64-4f4f-96a4-584642fc5825 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:36.423310 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-71d0de86-0d64-4f4f-96a4-584642fc5825 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:36.426195 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-71d0de86-0d64-4f4f-96a4-584642fc5825 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:36.426322 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-6ae4936c-a295-4d1b-99fa-9b3e521e068c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1321 microversion: 2.1 time: 0.274989 Oct 19 00:40:36.427200 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 68/151] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:36 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:36.429291 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-71d0de86-0d64-4f4f-96a4-584642fc5825 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:36.429740 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-71d0de86-0d64-4f4f-96a4-584642fc5825 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:36.432374 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-1ee68188-6d4d-4637-b782-c84b574a4e07 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:36.432873 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-1ee68188-6d4d-4637-b782-c84b574a4e07 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:36.440994 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1ee68188-6d4d-4637-b782-c84b574a4e07 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:36.441557 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1ee68188-6d4d-4637-b782-c84b574a4e07 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:36.442003 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1ee68188-6d4d-4637-b782-c84b574a4e07 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:36.442868 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1ee68188-6d4d-4637-b782-c84b574a4e07 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:36.443388 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1ee68188-6d4d-4637-b782-c84b574a4e07 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:36.443816 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1ee68188-6d4d-4637-b782-c84b574a4e07 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:36.534688 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-71d0de86-0d64-4f4f-96a4-584642fc5825 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ed34d4b774af4821303c98872e6e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab0bf27d6c7415f9d3fc8f873a0607f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:36.542693 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-71d0de86-0d64-4f4f-96a4-584642fc5825 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] 10.222.0.33 "GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738" status: 200 len: 1219 microversion: 2.1 time: 0.144467 Oct 19 00:40:36.544589 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 84/152] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:36 2022] GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738 => generated 1219 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:36.548679 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-39f9df7b-1e43-4d1a-b526-a995199dbc78 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:36.549286 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-39f9df7b-1e43-4d1a-b526-a995199dbc78 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 361dfd3b-f488-4dac-9511-f28c93f74d37] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:36.555362 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-39f9df7b-1e43-4d1a-b526-a995199dbc78 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:36.555846 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-39f9df7b-1e43-4d1a-b526-a995199dbc78 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:36.556304 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-39f9df7b-1e43-4d1a-b526-a995199dbc78 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:36.556994 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-39f9df7b-1e43-4d1a-b526-a995199dbc78 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:36.557441 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-39f9df7b-1e43-4d1a-b526-a995199dbc78 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:36.557854 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-39f9df7b-1e43-4d1a-b526-a995199dbc78 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:36.600109 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-1ee68188-6d4d-4637-b782-c84b574a4e07 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.171684 Oct 19 00:40:36.600853 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 69/153] 10.222.0.33 () {60 vars in 1316 bytes} [Wed Oct 19 00:40:36 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2/os-interface => generated 284 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:40:36.990544 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-39f9df7b-1e43-4d1a-b526-a995199dbc78 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:37.007308 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-39f9df7b-1e43-4d1a-b526-a995199dbc78 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37" status: 200 len: 1366 microversion: 2.1 time: 0.462629 Oct 19 00:40:37.008278 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 85/154] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:36 2022] GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37 => generated 1366 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:37.177195 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-0670d595-7177-4f03-9da9-9404e0c7e4b2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:37.178370 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-0670d595-7177-4f03-9da9-9404e0c7e4b2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:37.186070 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0670d595-7177-4f03-9da9-9404e0c7e4b2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:37.186688 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0670d595-7177-4f03-9da9-9404e0c7e4b2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:37.188756 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0670d595-7177-4f03-9da9-9404e0c7e4b2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:37.189832 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0670d595-7177-4f03-9da9-9404e0c7e4b2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:37.190508 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0670d595-7177-4f03-9da9-9404e0c7e4b2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:37.191166 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0670d595-7177-4f03-9da9-9404e0c7e4b2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:37.429090 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-6644fb94-d96c-4ad6-8a71-810352ef59a0 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:37.429721 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-6644fb94-d96c-4ad6-8a71-810352ef59a0 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] [instance: 27c84340-8c49-4f3f-8c36-eb1a2cdaa804] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:37.449673 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6644fb94-d96c-4ad6-8a71-810352ef59a0 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:37.455575 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6644fb94-d96c-4ad6-8a71-810352ef59a0 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:37.456249 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6644fb94-d96c-4ad6-8a71-810352ef59a0 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:37.457253 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6644fb94-d96c-4ad6-8a71-810352ef59a0 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:37.457749 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6644fb94-d96c-4ad6-8a71-810352ef59a0 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:37.458170 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6644fb94-d96c-4ad6-8a71-810352ef59a0 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:37.665691 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-0670d595-7177-4f03-9da9-9404e0c7e4b2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:37.677050 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-0670d595-7177-4f03-9da9-9404e0c7e4b2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1364 microversion: 2.1 time: 0.503780 Oct 19 00:40:37.677870 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 70/155] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:37 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1364 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:37.682702 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-c1055039-a299-48e9-9cc4-48dc53edde4b tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64414ea2-c1da-4648-90a1-e50149eb05ff"}} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:40:37.685339 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-c1055039-a299-48e9-9cc4-48dc53edde4b tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:37.697413 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c1055039-a299-48e9-9cc4-48dc53edde4b tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:37.697899 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c1055039-a299-48e9-9cc4-48dc53edde4b tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:37.698360 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c1055039-a299-48e9-9cc4-48dc53edde4b tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:37.699065 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c1055039-a299-48e9-9cc4-48dc53edde4b tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:37.699516 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c1055039-a299-48e9-9cc4-48dc53edde4b tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:37.699968 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c1055039-a299-48e9-9cc4-48dc53edde4b tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:37.744979 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-6644fb94-d96c-4ad6-8a71-810352ef59a0 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e5b2b9d844730bf0c955c1c47b582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78099a2acb31422095531592b7c2da20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:37.759348 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-6644fb94-d96c-4ad6-8a71-810352ef59a0 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] 10.222.0.33 "GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804" status: 200 len: 1313 microversion: 2.1 time: 0.339183 Oct 19 00:40:37.760312 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 86/156] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:37 2022] GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804 => generated 1313 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:40:37.765437 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-f53f7b6b-5b21-4585-bf0c-6da4c1e0cbed tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:37.766563 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-f53f7b6b-5b21-4585-bf0c-6da4c1e0cbed tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:37.774879 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f53f7b6b-5b21-4585-bf0c-6da4c1e0cbed tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:37.776825 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f53f7b6b-5b21-4585-bf0c-6da4c1e0cbed tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:37.777820 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f53f7b6b-5b21-4585-bf0c-6da4c1e0cbed tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:37.779955 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f53f7b6b-5b21-4585-bf0c-6da4c1e0cbed tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:37.780531 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f53f7b6b-5b21-4585-bf0c-6da4c1e0cbed tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:37.781061 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f53f7b6b-5b21-4585-bf0c-6da4c1e0cbed tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:38.286081 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-f53f7b6b-5b21-4585-bf0c-6da4c1e0cbed tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:38.296439 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-f53f7b6b-5b21-4585-bf0c-6da4c1e0cbed tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1321 microversion: 2.1 time: 0.534836 Oct 19 00:40:38.297774 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 87/157] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:37 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1321 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:38.304119 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-a0347e66-6a02-4b00-965a-32b2c75ed305 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:38.305013 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-a0347e66-6a02-4b00-965a-32b2c75ed305 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] [instance: da272379-872f-4ae8-b961-47c6c5a50738] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:38.316472 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a0347e66-6a02-4b00-965a-32b2c75ed305 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:38.317204 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a0347e66-6a02-4b00-965a-32b2c75ed305 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:38.317779 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a0347e66-6a02-4b00-965a-32b2c75ed305 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:38.318672 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a0347e66-6a02-4b00-965a-32b2c75ed305 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:38.319471 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a0347e66-6a02-4b00-965a-32b2c75ed305 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:38.320134 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a0347e66-6a02-4b00-965a-32b2c75ed305 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:38.411244 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-a0347e66-6a02-4b00-965a-32b2c75ed305 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ed34d4b774af4821303c98872e6e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab0bf27d6c7415f9d3fc8f873a0607f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:38.420776 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-a0347e66-6a02-4b00-965a-32b2c75ed305 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] 10.222.0.33 "GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738" status: 200 len: 1211 microversion: 2.1 time: 0.121807 Oct 19 00:40:38.421929 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 88/158] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:38 2022] GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738 => generated 1211 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:38.427263 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-e0cff0d6-23d1-4a4e-8a02-208f6bf39b68 req-accb3e27-6745-456b-9fd0-f145cef150bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27c84340-8c49-4f3f-8c36-eb1a2cdaa804", "tag": "374201f0-520a-464b-a895-e94e0d2f5296"}]} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:40:38.438621 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-e0cff0d6-23d1-4a4e-8a02-208f6bf39b68 req-accb3e27-6745-456b-9fd0-f145cef150bb service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:38.439760 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-e0cff0d6-23d1-4a4e-8a02-208f6bf39b68 req-accb3e27-6745-456b-9fd0-f145cef150bb service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:38.440230 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-e0cff0d6-23d1-4a4e-8a02-208f6bf39b68 req-accb3e27-6745-456b-9fd0-f145cef150bb service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:38.452801 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.compute.server_external_events [req-e0cff0d6-23d1-4a4e-8a02-208f6bf39b68 req-accb3e27-6745-456b-9fd0-f145cef150bb service nova] Creating event network-changed:374201f0-520a-464b-a895-e94e0d2f5296 for instance 27c84340-8c49-4f3f-8c36-eb1a2cdaa804 on hv-cinder-maste Oct 19 00:40:38.457791 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-e0cff0d6-23d1-4a4e-8a02-208f6bf39b68 req-accb3e27-6745-456b-9fd0-f145cef150bb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034563 Oct 19 00:40:38.458390 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 89/159] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:40:38.463627 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-28224a26-a6d3-447f-a394-4838a44e5dbb tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:38.464504 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-28224a26-a6d3-447f-a394-4838a44e5dbb tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 361dfd3b-f488-4dac-9511-f28c93f74d37] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:38.471645 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-28224a26-a6d3-447f-a394-4838a44e5dbb tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:38.472179 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-28224a26-a6d3-447f-a394-4838a44e5dbb tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:38.472613 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-28224a26-a6d3-447f-a394-4838a44e5dbb tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:38.473313 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-28224a26-a6d3-447f-a394-4838a44e5dbb tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:38.473783 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-28224a26-a6d3-447f-a394-4838a44e5dbb tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:38.474286 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-28224a26-a6d3-447f-a394-4838a44e5dbb tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:38.761219 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-28224a26-a6d3-447f-a394-4838a44e5dbb tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:38.771012 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-28224a26-a6d3-447f-a394-4838a44e5dbb tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37" status: 200 len: 1555 microversion: 2.1 time: 0.311193 Oct 19 00:40:38.772447 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 90/160] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:38 2022] GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37 => generated 1555 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:38.777217 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-7f38db89-e39f-4ac5-8a50-779e466fa59e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:38.778137 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-7f38db89-e39f-4ac5-8a50-779e466fa59e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:38.789878 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7f38db89-e39f-4ac5-8a50-779e466fa59e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:38.791924 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7f38db89-e39f-4ac5-8a50-779e466fa59e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:38.796445 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7f38db89-e39f-4ac5-8a50-779e466fa59e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:38.797203 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7f38db89-e39f-4ac5-8a50-779e466fa59e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:38.797677 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7f38db89-e39f-4ac5-8a50-779e466fa59e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:38.798144 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7f38db89-e39f-4ac5-8a50-779e466fa59e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:38.936239 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-7f38db89-e39f-4ac5-8a50-779e466fa59e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:38.943827 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-7f38db89-e39f-4ac5-8a50-779e466fa59e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1364 microversion: 2.1 time: 0.170273 Oct 19 00:40:38.944406 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 91/161] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:38 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:38.948981 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-02cc68b5-e008-494b-9e3c-9ed2b23cbce7 req-ea514a8c-0fe6-430d-bbad-73d87063adb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c74fb45-ef8a-4a88-8126-21c8266fddb2", "tag": "7926b647-0ec9-46fb-9fed-f33f2ff9fbcf"}]} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:40:38.959270 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-02cc68b5-e008-494b-9e3c-9ed2b23cbce7 req-ea514a8c-0fe6-430d-bbad-73d87063adb8 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:38.959744 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-02cc68b5-e008-494b-9e3c-9ed2b23cbce7 req-ea514a8c-0fe6-430d-bbad-73d87063adb8 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:38.960203 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-02cc68b5-e008-494b-9e3c-9ed2b23cbce7 req-ea514a8c-0fe6-430d-bbad-73d87063adb8 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:38.972038 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.compute.server_external_events [req-02cc68b5-e008-494b-9e3c-9ed2b23cbce7 req-ea514a8c-0fe6-430d-bbad-73d87063adb8 service nova] Creating event network-changed:7926b647-0ec9-46fb-9fed-f33f2ff9fbcf for instance 1c74fb45-ef8a-4a88-8126-21c8266fddb2 on hv-cinder-maste Oct 19 00:40:38.976840 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-02cc68b5-e008-494b-9e3c-9ed2b23cbce7 req-ea514a8c-0fe6-430d-bbad-73d87063adb8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031355 Oct 19 00:40:38.977420 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 92/162] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:40:38.982329 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-484d6289-0274-4b86-9123-030602327f17 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:38.983025 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-484d6289-0274-4b86-9123-030602327f17 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] [instance: 27c84340-8c49-4f3f-8c36-eb1a2cdaa804] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:38.989356 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-484d6289-0274-4b86-9123-030602327f17 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:38.989834 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-484d6289-0274-4b86-9123-030602327f17 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:38.990261 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-484d6289-0274-4b86-9123-030602327f17 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:38.990945 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-484d6289-0274-4b86-9123-030602327f17 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:38.991391 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-484d6289-0274-4b86-9123-030602327f17 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:38.991807 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-484d6289-0274-4b86-9123-030602327f17 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:39.127453 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-484d6289-0274-4b86-9123-030602327f17 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e5b2b9d844730bf0c955c1c47b582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78099a2acb31422095531592b7c2da20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:39.135211 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-484d6289-0274-4b86-9123-030602327f17 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] 10.222.0.33 "GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804" status: 200 len: 1313 microversion: 2.1 time: 0.156709 Oct 19 00:40:39.135778 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 93/163] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:38 2022] GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:39.140377 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-813c7bbe-d9b5-47cd-b2c2-f177ec3368c5 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:39.141025 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-813c7bbe-d9b5-47cd-b2c2-f177ec3368c5 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 361dfd3b-f488-4dac-9511-f28c93f74d37] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:39.146811 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-813c7bbe-d9b5-47cd-b2c2-f177ec3368c5 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:39.147208 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-813c7bbe-d9b5-47cd-b2c2-f177ec3368c5 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:39.147942 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-813c7bbe-d9b5-47cd-b2c2-f177ec3368c5 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:39.148432 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-813c7bbe-d9b5-47cd-b2c2-f177ec3368c5 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:39.148881 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-813c7bbe-d9b5-47cd-b2c2-f177ec3368c5 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:39.149301 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-813c7bbe-d9b5-47cd-b2c2-f177ec3368c5 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:39.268071 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-813c7bbe-d9b5-47cd-b2c2-f177ec3368c5 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131149 Oct 19 00:40:39.268694 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 94/164] 10.222.0.33 () {58 vars in 1275 bytes} [Wed Oct 19 00:40:39 2022] GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37/os-interface => generated 284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:40:39.321464 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-893f36c4-01ee-43e2-80fd-82be4916229d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:39.322439 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-893f36c4-01ee-43e2-80fd-82be4916229d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:39.331303 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-893f36c4-01ee-43e2-80fd-82be4916229d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:39.331816 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-893f36c4-01ee-43e2-80fd-82be4916229d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:39.332274 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-893f36c4-01ee-43e2-80fd-82be4916229d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:39.332977 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-893f36c4-01ee-43e2-80fd-82be4916229d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:39.333428 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-893f36c4-01ee-43e2-80fd-82be4916229d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:39.333851 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-893f36c4-01ee-43e2-80fd-82be4916229d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:39.354896 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell1:SELECT=100 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:39.579258 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-893f36c4-01ee-43e2-80fd-82be4916229d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:39.587838 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-893f36c4-01ee-43e2-80fd-82be4916229d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1321 microversion: 2.1 time: 0.270555 Oct 19 00:40:39.588755 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 95/165] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:39 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1321 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:40:39.594758 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-de96d8c4-a9fa-49ea-b2a8-cab12e63d5f3 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:39.595654 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-de96d8c4-a9fa-49ea-b2a8-cab12e63d5f3 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] [instance: da272379-872f-4ae8-b961-47c6c5a50738] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:39.603216 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-de96d8c4-a9fa-49ea-b2a8-cab12e63d5f3 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:39.604128 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-de96d8c4-a9fa-49ea-b2a8-cab12e63d5f3 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:39.604763 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-de96d8c4-a9fa-49ea-b2a8-cab12e63d5f3 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:39.605694 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-de96d8c4-a9fa-49ea-b2a8-cab12e63d5f3 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:39.606225 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-de96d8c4-a9fa-49ea-b2a8-cab12e63d5f3 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:39.606757 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-de96d8c4-a9fa-49ea-b2a8-cab12e63d5f3 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:39.740172 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-de96d8c4-a9fa-49ea-b2a8-cab12e63d5f3 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ed34d4b774af4821303c98872e6e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab0bf27d6c7415f9d3fc8f873a0607f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:39.748382 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-de96d8c4-a9fa-49ea-b2a8-cab12e63d5f3 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] 10.222.0.33 "GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738" status: 200 len: 1211 microversion: 2.1 time: 0.157649 Oct 19 00:40:39.749174 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 96/166] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:39 2022] GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738 => generated 1211 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:39.967841 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-4a25e3e2-46ca-45e8-b235-b5a215072858 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:39.968352 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-4a25e3e2-46ca-45e8-b235-b5a215072858 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:39.975044 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4a25e3e2-46ca-45e8-b235-b5a215072858 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:39.975689 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4a25e3e2-46ca-45e8-b235-b5a215072858 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:39.976267 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4a25e3e2-46ca-45e8-b235-b5a215072858 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:39.977077 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4a25e3e2-46ca-45e8-b235-b5a215072858 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:39.977647 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4a25e3e2-46ca-45e8-b235-b5a215072858 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:39.978259 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4a25e3e2-46ca-45e8-b235-b5a215072858 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:40.231806 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-4a25e3e2-46ca-45e8-b235-b5a215072858 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:40.240551 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-4a25e3e2-46ca-45e8-b235-b5a215072858 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1364 microversion: 2.1 time: 0.277624 Oct 19 00:40:40.241393 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 97/167] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:39 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1364 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:40:40.246386 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-097c9b88-81e7-4fbd-96ea-181918b5a5f1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:40.247081 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-097c9b88-81e7-4fbd-96ea-181918b5a5f1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] [instance: 27c84340-8c49-4f3f-8c36-eb1a2cdaa804] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:40.254099 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-097c9b88-81e7-4fbd-96ea-181918b5a5f1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:40.254672 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-097c9b88-81e7-4fbd-96ea-181918b5a5f1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:40.255180 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-097c9b88-81e7-4fbd-96ea-181918b5a5f1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:40.255999 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-097c9b88-81e7-4fbd-96ea-181918b5a5f1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:40.256732 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-097c9b88-81e7-4fbd-96ea-181918b5a5f1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:40.257325 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-097c9b88-81e7-4fbd-96ea-181918b5a5f1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:40.488981 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-097c9b88-81e7-4fbd-96ea-181918b5a5f1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e5b2b9d844730bf0c955c1c47b582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78099a2acb31422095531592b7c2da20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:40.505354 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-097c9b88-81e7-4fbd-96ea-181918b5a5f1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] 10.222.0.33 "GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804" status: 200 len: 1313 microversion: 2.1 time: 0.263018 Oct 19 00:40:40.507304 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 98/168] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:40 2022] GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804 => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:40.615743 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-46631787-af3d-4bf5-95c2-06f42ec1797c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:40.617105 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-46631787-af3d-4bf5-95c2-06f42ec1797c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:40.624055 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-46631787-af3d-4bf5-95c2-06f42ec1797c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:40.624609 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-46631787-af3d-4bf5-95c2-06f42ec1797c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:40.625109 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-46631787-af3d-4bf5-95c2-06f42ec1797c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:40.625893 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-46631787-af3d-4bf5-95c2-06f42ec1797c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:40.626409 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-46631787-af3d-4bf5-95c2-06f42ec1797c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:40.626891 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-46631787-af3d-4bf5-95c2-06f42ec1797c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:40.758342 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-46631787-af3d-4bf5-95c2-06f42ec1797c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:40.766313 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-46631787-af3d-4bf5-95c2-06f42ec1797c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1321 microversion: 2.1 time: 0.155170 Oct 19 00:40:40.766883 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 99/169] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:40 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:40.771572 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-322647bf-ab83-40b0-b07c-bcba21e8d2cc tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:40.772223 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-322647bf-ab83-40b0-b07c-bcba21e8d2cc tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] [instance: da272379-872f-4ae8-b961-47c6c5a50738] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:40.778044 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-322647bf-ab83-40b0-b07c-bcba21e8d2cc tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:40.778538 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-322647bf-ab83-40b0-b07c-bcba21e8d2cc tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:40.779537 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-322647bf-ab83-40b0-b07c-bcba21e8d2cc tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:40.780252 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-322647bf-ab83-40b0-b07c-bcba21e8d2cc tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:40.780721 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-322647bf-ab83-40b0-b07c-bcba21e8d2cc tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:40.781141 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-322647bf-ab83-40b0-b07c-bcba21e8d2cc tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:40.842985 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-322647bf-ab83-40b0-b07c-bcba21e8d2cc tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ed34d4b774af4821303c98872e6e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab0bf27d6c7415f9d3fc8f873a0607f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:40.850561 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-322647bf-ab83-40b0-b07c-bcba21e8d2cc tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] 10.222.0.33 "GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738" status: 200 len: 1211 microversion: 2.1 time: 0.082559 Oct 19 00:40:40.851120 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 100/170] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:40 2022] GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738 => generated 1211 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:40.991499 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-ef76d90f-983f-4707-bcc7-9f52e1a6db22 req-667d1f92-6470-418b-a45d-65053889e311 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "361dfd3b-f488-4dac-9511-f28c93f74d37", "tag": "579ced1d-44c1-46ae-bffb-7e11769e3f01"}]} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:40:41.000658 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-ef76d90f-983f-4707-bcc7-9f52e1a6db22 req-667d1f92-6470-418b-a45d-65053889e311 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:41.001133 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-ef76d90f-983f-4707-bcc7-9f52e1a6db22 req-667d1f92-6470-418b-a45d-65053889e311 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:41.001557 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-ef76d90f-983f-4707-bcc7-9f52e1a6db22 req-667d1f92-6470-418b-a45d-65053889e311 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:41.014499 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.compute.server_external_events [req-ef76d90f-983f-4707-bcc7-9f52e1a6db22 req-667d1f92-6470-418b-a45d-65053889e311 service nova] Creating event network-changed:579ced1d-44c1-46ae-bffb-7e11769e3f01 for instance 361dfd3b-f488-4dac-9511-f28c93f74d37 on hv-cinder-maste Oct 19 00:40:41.019312 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-ef76d90f-983f-4707-bcc7-9f52e1a6db22 req-667d1f92-6470-418b-a45d-65053889e311 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031492 Oct 19 00:40:41.019925 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 101/171] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:40:41.264677 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-68e4ec7a-75d1-43f0-84b5-cb545fe8b726 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:41.264810 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-68e4ec7a-75d1-43f0-84b5-cb545fe8b726 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:41.270928 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-68e4ec7a-75d1-43f0-84b5-cb545fe8b726 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:41.271408 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-68e4ec7a-75d1-43f0-84b5-cb545fe8b726 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:41.271838 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-68e4ec7a-75d1-43f0-84b5-cb545fe8b726 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:41.272680 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-68e4ec7a-75d1-43f0-84b5-cb545fe8b726 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:41.273140 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-68e4ec7a-75d1-43f0-84b5-cb545fe8b726 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:41.273562 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-68e4ec7a-75d1-43f0-84b5-cb545fe8b726 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:41.419082 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-68e4ec7a-75d1-43f0-84b5-cb545fe8b726 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:41.427201 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-68e4ec7a-75d1-43f0-84b5-cb545fe8b726 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1364 microversion: 2.1 time: 0.168046 Oct 19 00:40:41.427775 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 102/172] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:41 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:41.527584 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-22dcab95-da0c-4bef-8aa4-6273a575c973 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:41.528221 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-22dcab95-da0c-4bef-8aa4-6273a575c973 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] [instance: 27c84340-8c49-4f3f-8c36-eb1a2cdaa804] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:41.542005 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-22dcab95-da0c-4bef-8aa4-6273a575c973 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:41.542269 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-22dcab95-da0c-4bef-8aa4-6273a575c973 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:41.542698 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-22dcab95-da0c-4bef-8aa4-6273a575c973 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:41.543589 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-22dcab95-da0c-4bef-8aa4-6273a575c973 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:41.544077 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-22dcab95-da0c-4bef-8aa4-6273a575c973 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:41.544530 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-22dcab95-da0c-4bef-8aa4-6273a575c973 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:41.699798 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-22dcab95-da0c-4bef-8aa4-6273a575c973 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e5b2b9d844730bf0c955c1c47b582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78099a2acb31422095531592b7c2da20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:41.709339 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-22dcab95-da0c-4bef-8aa4-6273a575c973 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] 10.222.0.33 "GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804" status: 200 len: 1313 microversion: 2.1 time: 0.185515 Oct 19 00:40:41.710016 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 103/173] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:41 2022] GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:40:41.790631 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-c9bd7481-2937-468c-ab8f-efab00206628 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:41.791563 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-c9bd7481-2937-468c-ab8f-efab00206628 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:41.798355 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c9bd7481-2937-468c-ab8f-efab00206628 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:41.799101 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c9bd7481-2937-468c-ab8f-efab00206628 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:41.799785 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c9bd7481-2937-468c-ab8f-efab00206628 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:41.800936 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c9bd7481-2937-468c-ab8f-efab00206628 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:41.801412 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c9bd7481-2937-468c-ab8f-efab00206628 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:41.801898 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c9bd7481-2937-468c-ab8f-efab00206628 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:41.994818 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-c9bd7481-2937-468c-ab8f-efab00206628 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:42.017360 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-c9bd7481-2937-468c-ab8f-efab00206628 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1321 microversion: 2.1 time: 0.231397 Oct 19 00:40:42.018999 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 104/174] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:41 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:40:42.024334 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-38a909e2-3822-4279-b7e0-3adb5ba02a58 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:42.025334 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-38a909e2-3822-4279-b7e0-3adb5ba02a58 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] [instance: da272379-872f-4ae8-b961-47c6c5a50738] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:42.033545 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-38a909e2-3822-4279-b7e0-3adb5ba02a58 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:42.034466 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-38a909e2-3822-4279-b7e0-3adb5ba02a58 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:42.035120 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-38a909e2-3822-4279-b7e0-3adb5ba02a58 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:42.036281 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-38a909e2-3822-4279-b7e0-3adb5ba02a58 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:42.036947 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-38a909e2-3822-4279-b7e0-3adb5ba02a58 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:42.037686 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-38a909e2-3822-4279-b7e0-3adb5ba02a58 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:42.119518 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-38a909e2-3822-4279-b7e0-3adb5ba02a58 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ed34d4b774af4821303c98872e6e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab0bf27d6c7415f9d3fc8f873a0607f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:42.128233 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-38a909e2-3822-4279-b7e0-3adb5ba02a58 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] 10.222.0.33 "GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738" status: 200 len: 1211 microversion: 2.1 time: 0.108177 Oct 19 00:40:42.128833 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 105/175] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:42 2022] GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738 => generated 1211 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:42.131566 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-c1055039-a299-48e9-9cc4-48dc53edde4b tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "POST /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.452418 Oct 19 00:40:42.135980 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 71/176] 10.222.0.33 () {60 vars in 1323 bytes} [Wed Oct 19 00:40:37 2022] POST /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641/os-volume_attachments => generated 194 bytes in 4454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:40:42.453932 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-df2f7931-019a-445d-91a3-b107fa41ea5b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:42.454567 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-df2f7931-019a-445d-91a3-b107fa41ea5b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:42.462674 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-df2f7931-019a-445d-91a3-b107fa41ea5b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:42.463157 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-df2f7931-019a-445d-91a3-b107fa41ea5b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:42.463580 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-df2f7931-019a-445d-91a3-b107fa41ea5b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:42.464371 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-df2f7931-019a-445d-91a3-b107fa41ea5b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:42.464818 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-df2f7931-019a-445d-91a3-b107fa41ea5b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:42.465226 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-df2f7931-019a-445d-91a3-b107fa41ea5b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:42.671741 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-df2f7931-019a-445d-91a3-b107fa41ea5b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:42.697378 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-df2f7931-019a-445d-91a3-b107fa41ea5b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1364 microversion: 2.1 time: 0.249112 Oct 19 00:40:42.698771 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 106/177] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:42 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1364 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:42.737519 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-4b030bbe-33aa-4b68-93c1-624ab18576e2 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:42.738820 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-4b030bbe-33aa-4b68-93c1-624ab18576e2 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] [instance: 27c84340-8c49-4f3f-8c36-eb1a2cdaa804] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:42.746831 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4b030bbe-33aa-4b68-93c1-624ab18576e2 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:42.748099 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4b030bbe-33aa-4b68-93c1-624ab18576e2 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:42.748903 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4b030bbe-33aa-4b68-93c1-624ab18576e2 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:42.749763 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4b030bbe-33aa-4b68-93c1-624ab18576e2 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:42.750365 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4b030bbe-33aa-4b68-93c1-624ab18576e2 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:42.751006 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4b030bbe-33aa-4b68-93c1-624ab18576e2 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:42.915725 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-4b030bbe-33aa-4b68-93c1-624ab18576e2 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e5b2b9d844730bf0c955c1c47b582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78099a2acb31422095531592b7c2da20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:42.924146 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-4b030bbe-33aa-4b68-93c1-624ab18576e2 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] 10.222.0.33 "GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804" status: 200 len: 1313 microversion: 2.1 time: 0.194320 Oct 19 00:40:42.924816 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 72/178] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:42 2022] GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:40:43.042366 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-8515df90-9b6a-4949-b3ec-02fadf3650ee tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:43.042957 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-8515df90-9b6a-4949-b3ec-02fadf3650ee tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:43.049455 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8515df90-9b6a-4949-b3ec-02fadf3650ee tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:43.050016 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8515df90-9b6a-4949-b3ec-02fadf3650ee tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:43.050350 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8515df90-9b6a-4949-b3ec-02fadf3650ee tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:43.051097 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8515df90-9b6a-4949-b3ec-02fadf3650ee tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:43.051469 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8515df90-9b6a-4949-b3ec-02fadf3650ee tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:43.051907 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8515df90-9b6a-4949-b3ec-02fadf3650ee tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:43.152680 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-13e24c2f-e7fb-4c93-9612-10e333442a34 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:43.154152 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-13e24c2f-e7fb-4c93-9612-10e333442a34 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] [instance: da272379-872f-4ae8-b961-47c6c5a50738] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:43.167348 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-13e24c2f-e7fb-4c93-9612-10e333442a34 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:43.170063 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-13e24c2f-e7fb-4c93-9612-10e333442a34 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:43.171374 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-13e24c2f-e7fb-4c93-9612-10e333442a34 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:43.175118 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-13e24c2f-e7fb-4c93-9612-10e333442a34 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:43.175747 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-13e24c2f-e7fb-4c93-9612-10e333442a34 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:43.176313 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-13e24c2f-e7fb-4c93-9612-10e333442a34 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:43.394470 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-13e24c2f-e7fb-4c93-9612-10e333442a34 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ed34d4b774af4821303c98872e6e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab0bf27d6c7415f9d3fc8f873a0607f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:43.403515 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-13e24c2f-e7fb-4c93-9612-10e333442a34 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] 10.222.0.33 "GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738" status: 200 len: 1211 microversion: 2.1 time: 0.255072 Oct 19 00:40:43.404796 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 73/179] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:43 2022] GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738 => generated 1211 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:40:43.625393 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-8515df90-9b6a-4949-b3ec-02fadf3650ee tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:43.634856 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-8515df90-9b6a-4949-b3ec-02fadf3650ee tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1321 microversion: 2.1 time: 0.596151 Oct 19 00:40:43.635713 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 107/180] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:43 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1321 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:43.723039 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-f1815d0d-33b6-42dc-9ec0-1724e5ddc849 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:43.723638 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-f1815d0d-33b6-42dc-9ec0-1724e5ddc849 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:43.730418 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f1815d0d-33b6-42dc-9ec0-1724e5ddc849 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:43.730874 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f1815d0d-33b6-42dc-9ec0-1724e5ddc849 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:43.731458 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f1815d0d-33b6-42dc-9ec0-1724e5ddc849 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:43.732952 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f1815d0d-33b6-42dc-9ec0-1724e5ddc849 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:43.733542 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f1815d0d-33b6-42dc-9ec0-1724e5ddc849 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:43.733962 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f1815d0d-33b6-42dc-9ec0-1724e5ddc849 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:43.879645 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-f1815d0d-33b6-42dc-9ec0-1724e5ddc849 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:43.891637 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-f1815d0d-33b6-42dc-9ec0-1724e5ddc849 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1364 microversion: 2.1 time: 0.172693 Oct 19 00:40:43.892544 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 74/181] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:43 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:43.948310 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-9d878868-fc46-4581-b5e2-264758775db9 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:43.949023 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-9d878868-fc46-4581-b5e2-264758775db9 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] [instance: 27c84340-8c49-4f3f-8c36-eb1a2cdaa804] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:43.957425 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9d878868-fc46-4581-b5e2-264758775db9 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:43.958854 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9d878868-fc46-4581-b5e2-264758775db9 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:43.959531 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9d878868-fc46-4581-b5e2-264758775db9 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:43.960771 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9d878868-fc46-4581-b5e2-264758775db9 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:43.961927 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9d878868-fc46-4581-b5e2-264758775db9 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:43.962856 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9d878868-fc46-4581-b5e2-264758775db9 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:44.113815 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-9d878868-fc46-4581-b5e2-264758775db9 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e5b2b9d844730bf0c955c1c47b582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78099a2acb31422095531592b7c2da20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:44.125586 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-9d878868-fc46-4581-b5e2-264758775db9 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] 10.222.0.33 "GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804" status: 200 len: 1313 microversion: 2.1 time: 0.181597 Oct 19 00:40:44.126801 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 108/182] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:43 2022] GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:44.426693 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-1a706c7b-9f1b-41c8-8be4-10db9f60793b tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:44.427302 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-1a706c7b-9f1b-41c8-8be4-10db9f60793b tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] [instance: da272379-872f-4ae8-b961-47c6c5a50738] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:44.433496 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1a706c7b-9f1b-41c8-8be4-10db9f60793b tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:44.433977 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1a706c7b-9f1b-41c8-8be4-10db9f60793b tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:44.434424 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1a706c7b-9f1b-41c8-8be4-10db9f60793b tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:44.435192 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1a706c7b-9f1b-41c8-8be4-10db9f60793b tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:44.435717 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1a706c7b-9f1b-41c8-8be4-10db9f60793b tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:44.436197 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1a706c7b-9f1b-41c8-8be4-10db9f60793b tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:44.501146 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-1a706c7b-9f1b-41c8-8be4-10db9f60793b tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ed34d4b774af4821303c98872e6e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab0bf27d6c7415f9d3fc8f873a0607f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:44.508722 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-1a706c7b-9f1b-41c8-8be4-10db9f60793b tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] 10.222.0.33 "GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738" status: 200 len: 1267 microversion: 2.1 time: 0.085786 Oct 19 00:40:44.509289 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 75/183] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:44 2022] GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738 => generated 1267 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:44.658607 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-82e7753b-02b6-4c13-808f-31ee52a8d9db tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:44.659247 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-82e7753b-02b6-4c13-808f-31ee52a8d9db tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:44.665234 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-82e7753b-02b6-4c13-808f-31ee52a8d9db tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:44.665803 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-82e7753b-02b6-4c13-808f-31ee52a8d9db tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:44.666237 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-82e7753b-02b6-4c13-808f-31ee52a8d9db tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:44.666927 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-82e7753b-02b6-4c13-808f-31ee52a8d9db tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:44.667379 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-82e7753b-02b6-4c13-808f-31ee52a8d9db tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:44.667801 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-82e7753b-02b6-4c13-808f-31ee52a8d9db tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:44.803260 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-82e7753b-02b6-4c13-808f-31ee52a8d9db tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:44.811624 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-82e7753b-02b6-4c13-808f-31ee52a8d9db tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1515 microversion: 2.1 time: 0.157420 Oct 19 00:40:44.812437 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 109/184] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:44 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:44.836658 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-abd95312-5f26-48eb-bab9-eb007f804a17 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:40:44.838894 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-abd95312-5f26-48eb-bab9-eb007f804a17 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:44.846748 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-abd95312-5f26-48eb-bab9-eb007f804a17 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:44.847241 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-abd95312-5f26-48eb-bab9-eb007f804a17 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:44.847678 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-abd95312-5f26-48eb-bab9-eb007f804a17 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:44.848419 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-abd95312-5f26-48eb-bab9-eb007f804a17 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:44.848877 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-abd95312-5f26-48eb-bab9-eb007f804a17 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:44.849302 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-abd95312-5f26-48eb-bab9-eb007f804a17 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:44.872847 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.objects.instance [None req-abd95312-5f26-48eb-bab9-eb007f804a17 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lazy-loading 'flavor' on Instance uuid 961ac14f-b764-4468-baa3-a3aa1eb26627 {{(pid=125531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:40:44.915184 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-edb8f3ab-1e00-46f6-8b93-f202b118e21c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:44.916016 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-edb8f3ab-1e00-46f6-8b93-f202b118e21c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:44.922167 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-edb8f3ab-1e00-46f6-8b93-f202b118e21c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:44.922681 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-edb8f3ab-1e00-46f6-8b93-f202b118e21c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:44.923190 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-edb8f3ab-1e00-46f6-8b93-f202b118e21c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:44.924319 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-edb8f3ab-1e00-46f6-8b93-f202b118e21c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:44.924946 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-edb8f3ab-1e00-46f6-8b93-f202b118e21c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:44.925593 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-edb8f3ab-1e00-46f6-8b93-f202b118e21c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:45.000651 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell0:SELECT=2 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:45.085701 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-abd95312-5f26-48eb-bab9-eb007f804a17 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "POST /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627/action" status: 200 len: 32 microversion: 2.1 time: 0.253270 Oct 19 00:40:45.088993 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 76/185] 10.222.0.33 () {60 vars in 1278 bytes} [Wed Oct 19 00:40:44 2022] POST /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627/action => generated 32 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 19 00:40:45.101465 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-5b183830-de03-4d9c-8a58-d8f93b3cf2e5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:45.102487 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-5b183830-de03-4d9c-8a58-d8f93b3cf2e5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:45.110990 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5b183830-de03-4d9c-8a58-d8f93b3cf2e5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:45.111593 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5b183830-de03-4d9c-8a58-d8f93b3cf2e5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:45.112207 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5b183830-de03-4d9c-8a58-d8f93b3cf2e5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:45.113028 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5b183830-de03-4d9c-8a58-d8f93b3cf2e5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:45.113667 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5b183830-de03-4d9c-8a58-d8f93b3cf2e5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:45.114153 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5b183830-de03-4d9c-8a58-d8f93b3cf2e5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:45.179088 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell0:SELECT=10 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:45.450567 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-edb8f3ab-1e00-46f6-8b93-f202b118e21c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:45.456441 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-5b183830-de03-4d9c-8a58-d8f93b3cf2e5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:45.463892 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-edb8f3ab-1e00-46f6-8b93-f202b118e21c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1364 microversion: 2.1 time: 0.550964 Oct 19 00:40:45.467037 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 110/186] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:44 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1364 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:45.470438 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-5b183830-de03-4d9c-8a58-d8f93b3cf2e5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1521 microversion: 2.1 time: 0.371145 Oct 19 00:40:45.485310 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 77/187] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:45 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1521 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:45.485310 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-a6723ec3-6823-45b3-a4dc-63667757a051 req-2b10c719-0bf9-4df0-8e62-7f3d11e15089 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f550e071-b7cd-4628-aff9-59e09cfcd654", "name": "network-vif-plugged", "status": "completed", "tag": "11a76c21-a751-4ca5-acc2-a510feda4607"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:40:45.505488 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-a6723ec3-6823-45b3-a4dc-63667757a051 req-2b10c719-0bf9-4df0-8e62-7f3d11e15089 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:45.505488 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-a6723ec3-6823-45b3-a4dc-63667757a051 req-2b10c719-0bf9-4df0-8e62-7f3d11e15089 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:45.505488 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-a6723ec3-6823-45b3-a4dc-63667757a051 req-2b10c719-0bf9-4df0-8e62-7f3d11e15089 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:45.505488 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:45.507641 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-72b03f00-6fdc-4546-9808-09a13ab545d1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:45.508451 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-72b03f00-6fdc-4546-9808-09a13ab545d1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] [instance: 27c84340-8c49-4f3f-8c36-eb1a2cdaa804] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:45.515269 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-72b03f00-6fdc-4546-9808-09a13ab545d1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:45.516081 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-72b03f00-6fdc-4546-9808-09a13ab545d1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:45.516691 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-72b03f00-6fdc-4546-9808-09a13ab545d1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:45.517551 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-72b03f00-6fdc-4546-9808-09a13ab545d1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:45.518155 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-72b03f00-6fdc-4546-9808-09a13ab545d1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:45.518729 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-72b03f00-6fdc-4546-9808-09a13ab545d1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:45.525745 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-a6723ec3-6823-45b3-a4dc-63667757a051 req-2b10c719-0bf9-4df0-8e62-7f3d11e15089 service nova] Creating event network-vif-plugged:11a76c21-a751-4ca5-acc2-a510feda4607 for instance f550e071-b7cd-4628-aff9-59e09cfcd654 on hv-cinder-maste Oct 19 00:40:45.533453 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-a6723ec3-6823-45b3-a4dc-63667757a051 req-2b10c719-0bf9-4df0-8e62-7f3d11e15089 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057992 Oct 19 00:40:45.534102 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 78/188] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:40:45.539806 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-48a1585f-7c86-455a-a539-b41689d0431e tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:45.542308 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-48a1585f-7c86-455a-a539-b41689d0431e tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] [instance: da272379-872f-4ae8-b961-47c6c5a50738] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:45.551608 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-48a1585f-7c86-455a-a539-b41689d0431e tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:45.552913 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-48a1585f-7c86-455a-a539-b41689d0431e tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:45.553626 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-48a1585f-7c86-455a-a539-b41689d0431e tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:45.554644 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-48a1585f-7c86-455a-a539-b41689d0431e tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:45.555676 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-48a1585f-7c86-455a-a539-b41689d0431e tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:45.556334 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-48a1585f-7c86-455a-a539-b41689d0431e tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:45.628454 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-48a1585f-7c86-455a-a539-b41689d0431e tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ed34d4b774af4821303c98872e6e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab0bf27d6c7415f9d3fc8f873a0607f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:45.636341 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-48a1585f-7c86-455a-a539-b41689d0431e tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] 10.222.0.33 "GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738" status: 200 len: 1267 microversion: 2.1 time: 0.100867 Oct 19 00:40:45.637017 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 79/189] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:45 2022] GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738 => generated 1267 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:45.725895 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-72b03f00-6fdc-4546-9808-09a13ab545d1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e5b2b9d844730bf0c955c1c47b582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78099a2acb31422095531592b7c2da20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:45.734473 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-72b03f00-6fdc-4546-9808-09a13ab545d1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] 10.222.0.33 "GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804" status: 200 len: 1313 microversion: 2.1 time: 0.265819 Oct 19 00:40:45.735266 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 111/190] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:45 2022] GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804 => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:46.490804 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-dd04ff85-25de-4edd-b404-93c90044114e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:46.491414 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-dd04ff85-25de-4edd-b404-93c90044114e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:46.498674 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dd04ff85-25de-4edd-b404-93c90044114e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:46.499150 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dd04ff85-25de-4edd-b404-93c90044114e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:46.499578 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dd04ff85-25de-4edd-b404-93c90044114e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:46.500283 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-6a1880b5-894f-4373-845e-1b5b9631e9b0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:46.500685 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dd04ff85-25de-4edd-b404-93c90044114e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:46.500779 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dd04ff85-25de-4edd-b404-93c90044114e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:46.500885 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-6a1880b5-894f-4373-845e-1b5b9631e9b0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:46.501136 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dd04ff85-25de-4edd-b404-93c90044114e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:46.506815 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6a1880b5-894f-4373-845e-1b5b9631e9b0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:46.507294 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6a1880b5-894f-4373-845e-1b5b9631e9b0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:46.507727 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6a1880b5-894f-4373-845e-1b5b9631e9b0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:46.508439 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6a1880b5-894f-4373-845e-1b5b9631e9b0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:46.508891 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6a1880b5-894f-4373-845e-1b5b9631e9b0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:46.509311 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6a1880b5-894f-4373-845e-1b5b9631e9b0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:46.643924 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-dd04ff85-25de-4edd-b404-93c90044114e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:46.647877 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-6a1880b5-894f-4373-845e-1b5b9631e9b0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:46.651561 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-dd04ff85-25de-4edd-b404-93c90044114e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1364 microversion: 2.1 time: 0.164551 Oct 19 00:40:46.652175 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 80/191] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:46 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:46.658006 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell1:SELECT=100 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:46.662284 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-fb56c2ec-b809-462c-bcf7-a78abc3346c6 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:46.663065 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-6a1880b5-894f-4373-845e-1b5b9631e9b0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1521 microversion: 2.1 time: 0.167338 Oct 19 00:40:46.663195 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-fb56c2ec-b809-462c-bcf7-a78abc3346c6 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] [instance: da272379-872f-4ae8-b961-47c6c5a50738] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:46.663763 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 112/192] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:46 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:40:46.669040 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fb56c2ec-b809-462c-bcf7-a78abc3346c6 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:46.670366 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fb56c2ec-b809-462c-bcf7-a78abc3346c6 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:46.670843 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fb56c2ec-b809-462c-bcf7-a78abc3346c6 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:46.671700 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fb56c2ec-b809-462c-bcf7-a78abc3346c6 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:46.672180 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fb56c2ec-b809-462c-bcf7-a78abc3346c6 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:46.672606 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fb56c2ec-b809-462c-bcf7-a78abc3346c6 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:46.734897 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-fb56c2ec-b809-462c-bcf7-a78abc3346c6 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ed34d4b774af4821303c98872e6e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab0bf27d6c7415f9d3fc8f873a0607f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:46.742707 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-fb56c2ec-b809-462c-bcf7-a78abc3346c6 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] 10.222.0.33 "GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738" status: 200 len: 1267 microversion: 2.1 time: 0.084138 Oct 19 00:40:46.743271 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 81/193] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:46 2022] GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738 => generated 1267 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:40:46.758434 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-04b7b9f6-c666-482c-b8da-87eaf2e6e36b tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:46.759044 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-04b7b9f6-c666-482c-b8da-87eaf2e6e36b tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] [instance: 27c84340-8c49-4f3f-8c36-eb1a2cdaa804] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:46.766017 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-04b7b9f6-c666-482c-b8da-87eaf2e6e36b tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:46.766494 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-04b7b9f6-c666-482c-b8da-87eaf2e6e36b tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:46.766924 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-04b7b9f6-c666-482c-b8da-87eaf2e6e36b tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:46.767606 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-04b7b9f6-c666-482c-b8da-87eaf2e6e36b tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:46.768100 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-04b7b9f6-c666-482c-b8da-87eaf2e6e36b tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:46.768522 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-04b7b9f6-c666-482c-b8da-87eaf2e6e36b tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:46.895511 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-04b7b9f6-c666-482c-b8da-87eaf2e6e36b tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e5b2b9d844730bf0c955c1c47b582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78099a2acb31422095531592b7c2da20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:46.903161 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-04b7b9f6-c666-482c-b8da-87eaf2e6e36b tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] 10.222.0.33 "GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804" status: 200 len: 1313 microversion: 2.1 time: 0.148600 Oct 19 00:40:46.903718 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 113/194] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:46 2022] GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:47.677875 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-94594e06-0e70-4cfc-b110-792dcb17e91f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:47.678510 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-94594e06-0e70-4cfc-b110-792dcb17e91f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:47.685435 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-94594e06-0e70-4cfc-b110-792dcb17e91f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:47.686063 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-94594e06-0e70-4cfc-b110-792dcb17e91f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:47.686496 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-94594e06-0e70-4cfc-b110-792dcb17e91f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:47.687186 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-94594e06-0e70-4cfc-b110-792dcb17e91f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:47.687634 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-94594e06-0e70-4cfc-b110-792dcb17e91f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:47.688083 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-94594e06-0e70-4cfc-b110-792dcb17e91f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:47.688467 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-b56aa623-5feb-40b8-88b1-56a38de3d200 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:47.689078 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-b56aa623-5feb-40b8-88b1-56a38de3d200 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:47.694988 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b56aa623-5feb-40b8-88b1-56a38de3d200 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:47.695492 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b56aa623-5feb-40b8-88b1-56a38de3d200 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:47.695955 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b56aa623-5feb-40b8-88b1-56a38de3d200 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:47.696638 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b56aa623-5feb-40b8-88b1-56a38de3d200 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:47.697092 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b56aa623-5feb-40b8-88b1-56a38de3d200 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:47.697513 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b56aa623-5feb-40b8-88b1-56a38de3d200 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:47.825375 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-94594e06-0e70-4cfc-b110-792dcb17e91f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:47.833915 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-94594e06-0e70-4cfc-b110-792dcb17e91f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1364 microversion: 2.1 time: 0.159872 Oct 19 00:40:47.834491 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 82/195] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:47 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:47.837016 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-b56aa623-5feb-40b8-88b1-56a38de3d200 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:47.838923 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-1877e8ce-6fe9-41a5-b8bc-00d930502abe tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:47.839708 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-1877e8ce-6fe9-41a5-b8bc-00d930502abe tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] [instance: da272379-872f-4ae8-b961-47c6c5a50738] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:47.845128 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-b56aa623-5feb-40b8-88b1-56a38de3d200 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1521 microversion: 2.1 time: 0.160585 Oct 19 00:40:47.845450 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1877e8ce-6fe9-41a5-b8bc-00d930502abe tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:47.845939 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1877e8ce-6fe9-41a5-b8bc-00d930502abe tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:47.846369 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 114/196] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:47 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:40:47.854393 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1877e8ce-6fe9-41a5-b8bc-00d930502abe tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:47.854393 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1877e8ce-6fe9-41a5-b8bc-00d930502abe tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:47.854393 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1877e8ce-6fe9-41a5-b8bc-00d930502abe tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:47.854393 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1877e8ce-6fe9-41a5-b8bc-00d930502abe tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:47.917577 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-1877e8ce-6fe9-41a5-b8bc-00d930502abe tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ed34d4b774af4821303c98872e6e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab0bf27d6c7415f9d3fc8f873a0607f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:47.925951 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-03abf186-52fe-42b4-983a-079601524e7d tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:47.926622 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-03abf186-52fe-42b4-983a-079601524e7d tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] [instance: 27c84340-8c49-4f3f-8c36-eb1a2cdaa804] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:47.926729 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-1877e8ce-6fe9-41a5-b8bc-00d930502abe tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] 10.222.0.33 "GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738" status: 200 len: 1267 microversion: 2.1 time: 0.091221 Oct 19 00:40:47.927248 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 83/197] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:47 2022] GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738 => generated 1267 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:47.932629 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-03abf186-52fe-42b4-983a-079601524e7d tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:47.933107 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-03abf186-52fe-42b4-983a-079601524e7d tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:47.933536 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-03abf186-52fe-42b4-983a-079601524e7d tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:47.934231 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-03abf186-52fe-42b4-983a-079601524e7d tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:47.934679 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-03abf186-52fe-42b4-983a-079601524e7d tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:47.935795 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-03abf186-52fe-42b4-983a-079601524e7d tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:48.062901 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-03abf186-52fe-42b4-983a-079601524e7d tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e5b2b9d844730bf0c955c1c47b582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78099a2acb31422095531592b7c2da20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:48.070539 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-03abf186-52fe-42b4-983a-079601524e7d tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] 10.222.0.33 "GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804" status: 200 len: 1313 microversion: 2.1 time: 0.148382 Oct 19 00:40:48.071114 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 115/198] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:47 2022] GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:40:48.857830 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-a90ddfad-fc59-4fbf-b4b9-48111104406d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:48.858466 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-a90ddfad-fc59-4fbf-b4b9-48111104406d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:48.865529 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a90ddfad-fc59-4fbf-b4b9-48111104406d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:48.866278 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a90ddfad-fc59-4fbf-b4b9-48111104406d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:48.866717 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a90ddfad-fc59-4fbf-b4b9-48111104406d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:48.867871 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a90ddfad-fc59-4fbf-b4b9-48111104406d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:48.868039 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a90ddfad-fc59-4fbf-b4b9-48111104406d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:48.868559 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a90ddfad-fc59-4fbf-b4b9-48111104406d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:48.871576 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-63d6fe97-28d7-4a8b-8b3e-1c507e47e569 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:48.872759 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-63d6fe97-28d7-4a8b-8b3e-1c507e47e569 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:48.881562 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-63d6fe97-28d7-4a8b-8b3e-1c507e47e569 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:48.882495 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-63d6fe97-28d7-4a8b-8b3e-1c507e47e569 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:48.883293 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-63d6fe97-28d7-4a8b-8b3e-1c507e47e569 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:48.884258 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-63d6fe97-28d7-4a8b-8b3e-1c507e47e569 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:48.884859 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-63d6fe97-28d7-4a8b-8b3e-1c507e47e569 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:48.885547 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-63d6fe97-28d7-4a8b-8b3e-1c507e47e569 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:49.079275 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-a90ddfad-fc59-4fbf-b4b9-48111104406d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:49.087871 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-a90ddfad-fc59-4fbf-b4b9-48111104406d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1364 microversion: 2.1 time: 0.233666 Oct 19 00:40:49.087871 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 84/199] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:48 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1364 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:49.092781 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-8e0cb004-d219-4158-951d-ae09d704ddc7 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:49.093392 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-8e0cb004-d219-4158-951d-ae09d704ddc7 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] [instance: da272379-872f-4ae8-b961-47c6c5a50738] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:49.099129 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8e0cb004-d219-4158-951d-ae09d704ddc7 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:49.099826 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8e0cb004-d219-4158-951d-ae09d704ddc7 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:49.100304 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8e0cb004-d219-4158-951d-ae09d704ddc7 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:49.100995 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8e0cb004-d219-4158-951d-ae09d704ddc7 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:49.101446 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8e0cb004-d219-4158-951d-ae09d704ddc7 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:49.102032 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8e0cb004-d219-4158-951d-ae09d704ddc7 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:49.135165 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-63d6fe97-28d7-4a8b-8b3e-1c507e47e569 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:49.143161 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-63d6fe97-28d7-4a8b-8b3e-1c507e47e569 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1521 microversion: 2.1 time: 0.277604 Oct 19 00:40:49.143725 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 116/200] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:48 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:40:49.148643 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-428440f5-1718-4ce6-a66c-80a025170d5d tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:49.149513 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-428440f5-1718-4ce6-a66c-80a025170d5d tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] [instance: 27c84340-8c49-4f3f-8c36-eb1a2cdaa804] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:49.155812 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-428440f5-1718-4ce6-a66c-80a025170d5d tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:49.156597 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-428440f5-1718-4ce6-a66c-80a025170d5d tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:49.157242 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-428440f5-1718-4ce6-a66c-80a025170d5d tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:49.158159 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-428440f5-1718-4ce6-a66c-80a025170d5d tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:49.158834 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-428440f5-1718-4ce6-a66c-80a025170d5d tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:49.159488 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-428440f5-1718-4ce6-a66c-80a025170d5d tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:49.171475 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-8e0cb004-d219-4158-951d-ae09d704ddc7 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ed34d4b774af4821303c98872e6e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab0bf27d6c7415f9d3fc8f873a0607f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:49.179325 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-8e0cb004-d219-4158-951d-ae09d704ddc7 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] 10.222.0.33 "GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738" status: 200 len: 1267 microversion: 2.1 time: 0.090186 Oct 19 00:40:49.179917 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 85/201] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:49 2022] GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738 => generated 1267 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:49.294456 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-428440f5-1718-4ce6-a66c-80a025170d5d tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e5b2b9d844730bf0c955c1c47b582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78099a2acb31422095531592b7c2da20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:49.303516 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-428440f5-1718-4ce6-a66c-80a025170d5d tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] 10.222.0.33 "GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804" status: 200 len: 1313 microversion: 2.1 time: 0.158396 Oct 19 00:40:49.304103 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 117/202] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:49 2022] GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:50.111795 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-2415e097-50b7-4da5-a12d-eb7e9dc5aaec tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:50.113566 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-2415e097-50b7-4da5-a12d-eb7e9dc5aaec tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:50.132491 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2415e097-50b7-4da5-a12d-eb7e9dc5aaec tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:50.133258 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2415e097-50b7-4da5-a12d-eb7e9dc5aaec tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:50.133862 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2415e097-50b7-4da5-a12d-eb7e9dc5aaec tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:50.148407 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2415e097-50b7-4da5-a12d-eb7e9dc5aaec tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:50.148958 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2415e097-50b7-4da5-a12d-eb7e9dc5aaec tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:50.149464 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2415e097-50b7-4da5-a12d-eb7e9dc5aaec tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:50.166206 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-4ae848f2-bfd2-4e50-a692-29cbf3f4bda6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:50.166954 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-4ae848f2-bfd2-4e50-a692-29cbf3f4bda6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:50.174326 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4ae848f2-bfd2-4e50-a692-29cbf3f4bda6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:50.174820 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4ae848f2-bfd2-4e50-a692-29cbf3f4bda6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:50.175280 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4ae848f2-bfd2-4e50-a692-29cbf3f4bda6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:50.176044 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4ae848f2-bfd2-4e50-a692-29cbf3f4bda6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:50.176661 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4ae848f2-bfd2-4e50-a692-29cbf3f4bda6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:50.177117 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4ae848f2-bfd2-4e50-a692-29cbf3f4bda6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:50.443689 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-2415e097-50b7-4da5-a12d-eb7e9dc5aaec tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:50.456383 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-2415e097-50b7-4da5-a12d-eb7e9dc5aaec tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1364 microversion: 2.1 time: 0.350753 Oct 19 00:40:50.456946 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 86/203] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:50 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1364 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:50.463775 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-3cea097e-222b-4705-89d1-557c92a3a4bc tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:50.464613 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-3cea097e-222b-4705-89d1-557c92a3a4bc tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] [instance: da272379-872f-4ae8-b961-47c6c5a50738] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:50.472797 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3cea097e-222b-4705-89d1-557c92a3a4bc tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:50.473549 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3cea097e-222b-4705-89d1-557c92a3a4bc tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:50.473975 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3cea097e-222b-4705-89d1-557c92a3a4bc tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:50.474819 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3cea097e-222b-4705-89d1-557c92a3a4bc tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:50.475272 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3cea097e-222b-4705-89d1-557c92a3a4bc tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:50.475692 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3cea097e-222b-4705-89d1-557c92a3a4bc tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:50.543620 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-3cea097e-222b-4705-89d1-557c92a3a4bc tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ed34d4b774af4821303c98872e6e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab0bf27d6c7415f9d3fc8f873a0607f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:50.553283 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-3cea097e-222b-4705-89d1-557c92a3a4bc tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] 10.222.0.33 "GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738" status: 200 len: 1273 microversion: 2.1 time: 0.095174 Oct 19 00:40:50.554174 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 87/204] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:50 2022] GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738 => generated 1273 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:50.559639 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-61c2d1eb-8de2-434c-86dd-912b769f36a3 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:50.560717 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-61c2d1eb-8de2-434c-86dd-912b769f36a3 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] [instance: 27c84340-8c49-4f3f-8c36-eb1a2cdaa804] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:50.569110 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-61c2d1eb-8de2-434c-86dd-912b769f36a3 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:50.569812 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-61c2d1eb-8de2-434c-86dd-912b769f36a3 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:50.570598 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-61c2d1eb-8de2-434c-86dd-912b769f36a3 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:50.571645 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-61c2d1eb-8de2-434c-86dd-912b769f36a3 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:50.572462 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-61c2d1eb-8de2-434c-86dd-912b769f36a3 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:50.572885 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-61c2d1eb-8de2-434c-86dd-912b769f36a3 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:50.599878 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-4ae848f2-bfd2-4e50-a692-29cbf3f4bda6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:50.610234 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-4ae848f2-bfd2-4e50-a692-29cbf3f4bda6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1521 microversion: 2.1 time: 0.447558 Oct 19 00:40:50.620559 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 118/205] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:50 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1521 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:50.723164 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-61c2d1eb-8de2-434c-86dd-912b769f36a3 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e5b2b9d844730bf0c955c1c47b582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78099a2acb31422095531592b7c2da20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:50.730698 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-61c2d1eb-8de2-434c-86dd-912b769f36a3 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] 10.222.0.33 "GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804" status: 200 len: 1313 microversion: 2.1 time: 0.175590 Oct 19 00:40:50.731253 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 88/206] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:50 2022] GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:50.897334 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-309e15f5-cfe8-4a82-9088-d1de4e271e6f tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:50.897825 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-309e15f5-cfe8-4a82-9088-d1de4e271e6f tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:50.903739 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-309e15f5-cfe8-4a82-9088-d1de4e271e6f tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:50.904244 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-309e15f5-cfe8-4a82-9088-d1de4e271e6f tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:50.904674 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-309e15f5-cfe8-4a82-9088-d1de4e271e6f tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:50.905446 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-309e15f5-cfe8-4a82-9088-d1de4e271e6f tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:50.905890 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-309e15f5-cfe8-4a82-9088-d1de4e271e6f tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:50.906305 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-309e15f5-cfe8-4a82-9088-d1de4e271e6f tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:50.930953 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-309e15f5-cfe8-4a82-9088-d1de4e271e6f tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Going to try to terminate instance {{(pid=125532) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:40:51.029520 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:51.035507 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-309e15f5-cfe8-4a82-9088-d1de4e271e6f tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641" status: 204 len: 0 microversion: 2.1 time: 0.141447 Oct 19 00:40:51.040276 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 119/207] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Oct 19 00:40:50 2022] DELETE /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:40:51.045876 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-a81f7dfe-1ab5-4460-ab03-824b76bbb658 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:51.046694 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-a81f7dfe-1ab5-4460-ab03-824b76bbb658 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:51.054738 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a81f7dfe-1ab5-4460-ab03-824b76bbb658 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:51.056395 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a81f7dfe-1ab5-4460-ab03-824b76bbb658 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:51.057064 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a81f7dfe-1ab5-4460-ab03-824b76bbb658 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:51.057973 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a81f7dfe-1ab5-4460-ab03-824b76bbb658 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:51.059446 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a81f7dfe-1ab5-4460-ab03-824b76bbb658 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:51.060077 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a81f7dfe-1ab5-4460-ab03-824b76bbb658 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:51.200669 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-a81f7dfe-1ab5-4460-ab03-824b76bbb658 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda9dd9eb8d3446c96b0c702dd09d2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb46376a666496b896ad085315c58fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:51.209060 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-a81f7dfe-1ab5-4460-ab03-824b76bbb658 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641" status: 200 len: 1554 microversion: 2.1 time: 0.167902 Oct 19 00:40:51.209826 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 89/208] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:51 2022] GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:51.484445 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-b795f9b9-fcce-465e-9e96-b702bc7940dd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:51.486096 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-b795f9b9-fcce-465e-9e96-b702bc7940dd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:51.493270 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b795f9b9-fcce-465e-9e96-b702bc7940dd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:51.494440 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b795f9b9-fcce-465e-9e96-b702bc7940dd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:51.494980 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b795f9b9-fcce-465e-9e96-b702bc7940dd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:51.495747 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b795f9b9-fcce-465e-9e96-b702bc7940dd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:51.496486 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b795f9b9-fcce-465e-9e96-b702bc7940dd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:51.496876 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b795f9b9-fcce-465e-9e96-b702bc7940dd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:51.577998 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-11799692-99bb-4c14-95e7-21d00360a8b0 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:51.578456 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-11799692-99bb-4c14-95e7-21d00360a8b0 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] [instance: da272379-872f-4ae8-b961-47c6c5a50738] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:51.585108 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-11799692-99bb-4c14-95e7-21d00360a8b0 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:51.585779 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-11799692-99bb-4c14-95e7-21d00360a8b0 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:51.586208 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-11799692-99bb-4c14-95e7-21d00360a8b0 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:51.587137 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-11799692-99bb-4c14-95e7-21d00360a8b0 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:51.587738 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-11799692-99bb-4c14-95e7-21d00360a8b0 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:51.588178 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-11799692-99bb-4c14-95e7-21d00360a8b0 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:51.657789 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-11799692-99bb-4c14-95e7-21d00360a8b0 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ed34d4b774af4821303c98872e6e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab0bf27d6c7415f9d3fc8f873a0607f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:51.666286 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-11799692-99bb-4c14-95e7-21d00360a8b0 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] 10.222.0.33 "GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738" status: 200 len: 1273 microversion: 2.1 time: 0.092202 Oct 19 00:40:51.675148 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 90/209] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:51 2022] GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738 => generated 1273 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:40:51.683717 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-2bf3fa44-2be1-424a-b4f2-73011eae95e1 req-415cc046-3837-464f-9ec8-1ea360f641b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27c84340-8c49-4f3f-8c36-eb1a2cdaa804", "name": "network-vif-plugged", "status": "completed", "tag": "374201f0-520a-464b-a895-e94e0d2f5296"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:40:51.700676 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-2bf3fa44-2be1-424a-b4f2-73011eae95e1 req-415cc046-3837-464f-9ec8-1ea360f641b9 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:51.701194 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-2bf3fa44-2be1-424a-b4f2-73011eae95e1 req-415cc046-3837-464f-9ec8-1ea360f641b9 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:51.701806 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-2bf3fa44-2be1-424a-b4f2-73011eae95e1 req-415cc046-3837-464f-9ec8-1ea360f641b9 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:51.714796 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-2bf3fa44-2be1-424a-b4f2-73011eae95e1 req-415cc046-3837-464f-9ec8-1ea360f641b9 service nova] Creating event network-vif-plugged:374201f0-520a-464b-a895-e94e0d2f5296 for instance 27c84340-8c49-4f3f-8c36-eb1a2cdaa804 on hv-cinder-maste Oct 19 00:40:51.721658 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-2bf3fa44-2be1-424a-b4f2-73011eae95e1 req-415cc046-3837-464f-9ec8-1ea360f641b9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052964 Oct 19 00:40:51.722297 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 91/210] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:40:51.722883 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-b795f9b9-fcce-465e-9e96-b702bc7940dd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:51.736077 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-8f7cb8ce-0c06-4092-9ccc-47d76239f836 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:51.736509 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-b795f9b9-fcce-465e-9e96-b702bc7940dd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1364 microversion: 2.1 time: 0.259212 Oct 19 00:40:51.736639 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-8f7cb8ce-0c06-4092-9ccc-47d76239f836 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:51.751555 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8f7cb8ce-0c06-4092-9ccc-47d76239f836 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:51.751555 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8f7cb8ce-0c06-4092-9ccc-47d76239f836 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:51.751555 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8f7cb8ce-0c06-4092-9ccc-47d76239f836 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:51.751555 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8f7cb8ce-0c06-4092-9ccc-47d76239f836 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:51.751833 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8f7cb8ce-0c06-4092-9ccc-47d76239f836 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:51.751833 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8f7cb8ce-0c06-4092-9ccc-47d76239f836 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:51.753677 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 120/211] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:51 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1364 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:51.760809 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-6b3c941e-1f60-4d2a-b784-dd1cc28af676 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:51.761673 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-6b3c941e-1f60-4d2a-b784-dd1cc28af676 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] [instance: 27c84340-8c49-4f3f-8c36-eb1a2cdaa804] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:51.770214 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6b3c941e-1f60-4d2a-b784-dd1cc28af676 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:51.770696 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6b3c941e-1f60-4d2a-b784-dd1cc28af676 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:51.771127 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6b3c941e-1f60-4d2a-b784-dd1cc28af676 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:51.771823 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6b3c941e-1f60-4d2a-b784-dd1cc28af676 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:51.772308 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6b3c941e-1f60-4d2a-b784-dd1cc28af676 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:51.772733 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6b3c941e-1f60-4d2a-b784-dd1cc28af676 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:51.898242 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-8f7cb8ce-0c06-4092-9ccc-47d76239f836 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:51.907966 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-8f7cb8ce-0c06-4092-9ccc-47d76239f836 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1521 microversion: 2.1 time: 0.182693 Oct 19 00:40:51.908556 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 92/212] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:51 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:51.937349 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-6b3c941e-1f60-4d2a-b784-dd1cc28af676 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e5b2b9d844730bf0c955c1c47b582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78099a2acb31422095531592b7c2da20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:51.945217 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-6b3c941e-1f60-4d2a-b784-dd1cc28af676 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] 10.222.0.33 "GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804" status: 200 len: 1313 microversion: 2.1 time: 0.190160 Oct 19 00:40:51.945788 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 121/213] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:51 2022] GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:52.232232 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-55796db2-2649-4182-a8e0-96e680ddb810 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:52.232900 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-55796db2-2649-4182-a8e0-96e680ddb810 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:52.239542 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-55796db2-2649-4182-a8e0-96e680ddb810 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:52.240054 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-55796db2-2649-4182-a8e0-96e680ddb810 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:52.240489 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-55796db2-2649-4182-a8e0-96e680ddb810 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:52.241196 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-55796db2-2649-4182-a8e0-96e680ddb810 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:52.241647 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-55796db2-2649-4182-a8e0-96e680ddb810 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:52.242062 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-55796db2-2649-4182-a8e0-96e680ddb810 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:52.370740 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-55796db2-2649-4182-a8e0-96e680ddb810 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda9dd9eb8d3446c96b0c702dd09d2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb46376a666496b896ad085315c58fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:52.379365 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-55796db2-2649-4182-a8e0-96e680ddb810 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641" status: 200 len: 1554 microversion: 2.1 time: 0.150949 Oct 19 00:40:52.379944 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 93/214] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:52 2022] GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:52.690167 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-441346b7-0ac4-4bb5-bc53-e5e2b3937599 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:52.690829 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-441346b7-0ac4-4bb5-bc53-e5e2b3937599 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] [instance: da272379-872f-4ae8-b961-47c6c5a50738] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:52.696772 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-441346b7-0ac4-4bb5-bc53-e5e2b3937599 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:52.697249 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-441346b7-0ac4-4bb5-bc53-e5e2b3937599 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:52.697680 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-441346b7-0ac4-4bb5-bc53-e5e2b3937599 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:52.698363 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-441346b7-0ac4-4bb5-bc53-e5e2b3937599 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:52.698812 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-441346b7-0ac4-4bb5-bc53-e5e2b3937599 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:52.699229 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-441346b7-0ac4-4bb5-bc53-e5e2b3937599 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:52.764466 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-b51214b6-e8de-4eee-bbcb-e1371313e347 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:52.765074 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-b51214b6-e8de-4eee-bbcb-e1371313e347 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:52.773604 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b51214b6-e8de-4eee-bbcb-e1371313e347 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:52.774089 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b51214b6-e8de-4eee-bbcb-e1371313e347 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:52.774785 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b51214b6-e8de-4eee-bbcb-e1371313e347 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:52.775192 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b51214b6-e8de-4eee-bbcb-e1371313e347 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:52.775736 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b51214b6-e8de-4eee-bbcb-e1371313e347 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:52.776134 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b51214b6-e8de-4eee-bbcb-e1371313e347 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:52.836984 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-441346b7-0ac4-4bb5-bc53-e5e2b3937599 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ed34d4b774af4821303c98872e6e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab0bf27d6c7415f9d3fc8f873a0607f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:52.848325 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-441346b7-0ac4-4bb5-bc53-e5e2b3937599 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] 10.222.0.33 "GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738" status: 200 len: 1315 microversion: 2.1 time: 0.162451 Oct 19 00:40:52.848904 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 122/215] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:52 2022] GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:52.919617 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-b51214b6-e8de-4eee-bbcb-e1371313e347 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:52.928488 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-b51214b6-e8de-4eee-bbcb-e1371313e347 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1364 microversion: 2.1 time: 0.167885 Oct 19 00:40:52.929044 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 94/216] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:52 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:40:52.930657 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-52f405d5-cb6b-45cb-a0d2-69c75991d29e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:52.931381 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-52f405d5-cb6b-45cb-a0d2-69c75991d29e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:52.937407 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-52f405d5-cb6b-45cb-a0d2-69c75991d29e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:52.937875 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-52f405d5-cb6b-45cb-a0d2-69c75991d29e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:52.938303 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-52f405d5-cb6b-45cb-a0d2-69c75991d29e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:52.938982 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-52f405d5-cb6b-45cb-a0d2-69c75991d29e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:52.939471 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-52f405d5-cb6b-45cb-a0d2-69c75991d29e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:52.939965 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-52f405d5-cb6b-45cb-a0d2-69c75991d29e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:52.970160 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-80a2ec9a-a239-47f5-bfc6-9e7d3f3939c4 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:52.970870 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-80a2ec9a-a239-47f5-bfc6-9e7d3f3939c4 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] [instance: 27c84340-8c49-4f3f-8c36-eb1a2cdaa804] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:52.976959 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-80a2ec9a-a239-47f5-bfc6-9e7d3f3939c4 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:52.977442 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-80a2ec9a-a239-47f5-bfc6-9e7d3f3939c4 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:52.977880 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-80a2ec9a-a239-47f5-bfc6-9e7d3f3939c4 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:52.978568 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-80a2ec9a-a239-47f5-bfc6-9e7d3f3939c4 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:52.979021 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-80a2ec9a-a239-47f5-bfc6-9e7d3f3939c4 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:52.979456 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-80a2ec9a-a239-47f5-bfc6-9e7d3f3939c4 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:53.068751 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-52f405d5-cb6b-45cb-a0d2-69c75991d29e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:53.076417 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-52f405d5-cb6b-45cb-a0d2-69c75991d29e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1521 microversion: 2.1 time: 0.149809 Oct 19 00:40:53.076981 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 123/217] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:52 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:40:53.112891 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-80a2ec9a-a239-47f5-bfc6-9e7d3f3939c4 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e5b2b9d844730bf0c955c1c47b582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78099a2acb31422095531592b7c2da20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:53.120467 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-80a2ec9a-a239-47f5-bfc6-9e7d3f3939c4 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] 10.222.0.33 "GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804" status: 200 len: 1313 microversion: 2.1 time: 0.154625 Oct 19 00:40:53.120969 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 95/218] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:52 2022] GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:40:53.403642 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-551a39a2-f5c2-4605-81ba-a2971d05da01 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:53.404913 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-551a39a2-f5c2-4605-81ba-a2971d05da01 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:53.411325 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-551a39a2-f5c2-4605-81ba-a2971d05da01 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:53.411806 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-551a39a2-f5c2-4605-81ba-a2971d05da01 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:53.412278 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-551a39a2-f5c2-4605-81ba-a2971d05da01 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:53.412984 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-551a39a2-f5c2-4605-81ba-a2971d05da01 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:53.413432 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-551a39a2-f5c2-4605-81ba-a2971d05da01 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:53.413853 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-551a39a2-f5c2-4605-81ba-a2971d05da01 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:53.541984 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-551a39a2-f5c2-4605-81ba-a2971d05da01 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda9dd9eb8d3446c96b0c702dd09d2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb46376a666496b896ad085315c58fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:53.550290 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-551a39a2-f5c2-4605-81ba-a2971d05da01 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641" status: 200 len: 1554 microversion: 2.1 time: 0.151096 Oct 19 00:40:53.550883 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 124/219] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:53 2022] GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:53.872126 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-f29e1fae-ed4a-4240-8dc8-2cd05e15cdbb tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:53.872732 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-f29e1fae-ed4a-4240-8dc8-2cd05e15cdbb tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] [instance: da272379-872f-4ae8-b961-47c6c5a50738] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:53.880539 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f29e1fae-ed4a-4240-8dc8-2cd05e15cdbb tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:53.880996 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f29e1fae-ed4a-4240-8dc8-2cd05e15cdbb tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:53.881422 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f29e1fae-ed4a-4240-8dc8-2cd05e15cdbb tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:53.882104 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f29e1fae-ed4a-4240-8dc8-2cd05e15cdbb tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:53.882554 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f29e1fae-ed4a-4240-8dc8-2cd05e15cdbb tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:53.882968 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f29e1fae-ed4a-4240-8dc8-2cd05e15cdbb tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:53.887233 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell1:SELECT=100 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:53.955383 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-55fbb085-8a64-406a-ad4e-6d7f0e0b15c4 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:53.956043 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-55fbb085-8a64-406a-ad4e-6d7f0e0b15c4 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:53.963224 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-55fbb085-8a64-406a-ad4e-6d7f0e0b15c4 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:53.963717 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-55fbb085-8a64-406a-ad4e-6d7f0e0b15c4 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:53.965256 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-55fbb085-8a64-406a-ad4e-6d7f0e0b15c4 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:53.966173 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-55fbb085-8a64-406a-ad4e-6d7f0e0b15c4 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:53.967991 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-55fbb085-8a64-406a-ad4e-6d7f0e0b15c4 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:53.968747 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-55fbb085-8a64-406a-ad4e-6d7f0e0b15c4 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:54.033551 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-f29e1fae-ed4a-4240-8dc8-2cd05e15cdbb tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ed34d4b774af4821303c98872e6e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab0bf27d6c7415f9d3fc8f873a0607f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:54.042398 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-f29e1fae-ed4a-4240-8dc8-2cd05e15cdbb tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] 10.222.0.33 "GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738" status: 200 len: 1315 microversion: 2.1 time: 0.174145 Oct 19 00:40:54.069970 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 96/220] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:53 2022] GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:54.112597 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-46823b98-879d-422a-bf61-44946f25ad17 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:54.115167 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-46823b98-879d-422a-bf61-44946f25ad17 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:54.131728 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-46823b98-879d-422a-bf61-44946f25ad17 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:54.133196 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-46823b98-879d-422a-bf61-44946f25ad17 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:54.133907 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-46823b98-879d-422a-bf61-44946f25ad17 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:54.135482 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-46823b98-879d-422a-bf61-44946f25ad17 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:54.136193 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-46823b98-879d-422a-bf61-44946f25ad17 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:54.137651 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-46823b98-879d-422a-bf61-44946f25ad17 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:54.301204 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-46823b98-879d-422a-bf61-44946f25ad17 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:54.309169 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-46823b98-879d-422a-bf61-44946f25ad17 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1521 microversion: 2.1 time: 0.211824 Oct 19 00:40:54.309474 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 97/221] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:54 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:54.314568 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-69a088c9-6da7-4f9a-a4ec-13b494ec7112 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:54.315172 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-69a088c9-6da7-4f9a-a4ec-13b494ec7112 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] [instance: 27c84340-8c49-4f3f-8c36-eb1a2cdaa804] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:54.321132 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-69a088c9-6da7-4f9a-a4ec-13b494ec7112 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:54.321610 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-69a088c9-6da7-4f9a-a4ec-13b494ec7112 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:54.322060 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-69a088c9-6da7-4f9a-a4ec-13b494ec7112 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:54.322912 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-69a088c9-6da7-4f9a-a4ec-13b494ec7112 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:54.323307 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-69a088c9-6da7-4f9a-a4ec-13b494ec7112 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:54.323812 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-69a088c9-6da7-4f9a-a4ec-13b494ec7112 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:54.390023 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-55fbb085-8a64-406a-ad4e-6d7f0e0b15c4 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:54.400805 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-55fbb085-8a64-406a-ad4e-6d7f0e0b15c4 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1364 microversion: 2.1 time: 0.453026 Oct 19 00:40:54.402077 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 125/222] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:53 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1364 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:40:54.455977 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-69a088c9-6da7-4f9a-a4ec-13b494ec7112 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e5b2b9d844730bf0c955c1c47b582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78099a2acb31422095531592b7c2da20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:54.463697 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-69a088c9-6da7-4f9a-a4ec-13b494ec7112 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] 10.222.0.33 "GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804" status: 200 len: 1313 microversion: 2.1 time: 0.153257 Oct 19 00:40:54.464295 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 98/223] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:54 2022] GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:54.573399 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-51792c38-3890-4bda-9b3f-09475f1511ba tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:54.574011 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-51792c38-3890-4bda-9b3f-09475f1511ba tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:54.580619 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-51792c38-3890-4bda-9b3f-09475f1511ba tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:54.581150 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-51792c38-3890-4bda-9b3f-09475f1511ba tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:54.581591 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-51792c38-3890-4bda-9b3f-09475f1511ba tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:54.582287 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-51792c38-3890-4bda-9b3f-09475f1511ba tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:54.582745 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-51792c38-3890-4bda-9b3f-09475f1511ba tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:54.583177 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-51792c38-3890-4bda-9b3f-09475f1511ba tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:54.815436 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-51792c38-3890-4bda-9b3f-09475f1511ba tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda9dd9eb8d3446c96b0c702dd09d2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb46376a666496b896ad085315c58fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:54.823873 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-51792c38-3890-4bda-9b3f-09475f1511ba tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641" status: 200 len: 1554 microversion: 2.1 time: 0.254279 Oct 19 00:40:54.824453 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 126/224] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:54 2022] GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 => generated 1554 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:54.988692 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-45a85304-3299-4262-b61e-b628678666d7 req-0aea4655-8313-462c-8fea-579856fc0803 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da272379-872f-4ae8-b961-47c6c5a50738", "tag": "5918f28b-5dd0-4997-a671-7857d13d7fd3"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:40:54.998548 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-45a85304-3299-4262-b61e-b628678666d7 req-0aea4655-8313-462c-8fea-579856fc0803 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:54.999040 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-45a85304-3299-4262-b61e-b628678666d7 req-0aea4655-8313-462c-8fea-579856fc0803 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:54.999534 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-45a85304-3299-4262-b61e-b628678666d7 req-0aea4655-8313-462c-8fea-579856fc0803 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:55.020801 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-45a85304-3299-4262-b61e-b628678666d7 req-0aea4655-8313-462c-8fea-579856fc0803 service nova] Creating event network-changed:5918f28b-5dd0-4997-a671-7857d13d7fd3 for instance da272379-872f-4ae8-b961-47c6c5a50738 on hv-cinder-maste Oct 19 00:40:55.025518 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-45a85304-3299-4262-b61e-b628678666d7 req-0aea4655-8313-462c-8fea-579856fc0803 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040852 Oct 19 00:40:55.026397 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 99/225] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:40:55.070418 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-617b9c4e-9f97-43f5-b624-1b19ca2c3ac3 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:55.071059 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-617b9c4e-9f97-43f5-b624-1b19ca2c3ac3 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] [instance: da272379-872f-4ae8-b961-47c6c5a50738] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:55.078556 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-617b9c4e-9f97-43f5-b624-1b19ca2c3ac3 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:55.078931 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-617b9c4e-9f97-43f5-b624-1b19ca2c3ac3 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:55.079353 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-617b9c4e-9f97-43f5-b624-1b19ca2c3ac3 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:55.080091 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-617b9c4e-9f97-43f5-b624-1b19ca2c3ac3 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:55.080547 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-617b9c4e-9f97-43f5-b624-1b19ca2c3ac3 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:55.080971 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-617b9c4e-9f97-43f5-b624-1b19ca2c3ac3 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:55.220723 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-617b9c4e-9f97-43f5-b624-1b19ca2c3ac3 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ed34d4b774af4821303c98872e6e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab0bf27d6c7415f9d3fc8f873a0607f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:55.224800 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:40:55.230356 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-617b9c4e-9f97-43f5-b624-1b19ca2c3ac3 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] 10.222.0.33 "GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738" status: 200 len: 1315 microversion: 2.1 time: 0.163768 Oct 19 00:40:55.230925 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 127/226] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:55 2022] GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:55.333469 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-71a679d6-326f-4bc9-89d3-abe7a30eae50 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:55.334159 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-71a679d6-326f-4bc9-89d3-abe7a30eae50 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:55.340165 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-71a679d6-326f-4bc9-89d3-abe7a30eae50 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:55.340641 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-71a679d6-326f-4bc9-89d3-abe7a30eae50 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:55.341067 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-71a679d6-326f-4bc9-89d3-abe7a30eae50 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:55.342404 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-71a679d6-326f-4bc9-89d3-abe7a30eae50 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:55.342691 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-71a679d6-326f-4bc9-89d3-abe7a30eae50 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:55.343220 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-71a679d6-326f-4bc9-89d3-abe7a30eae50 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:55.426628 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-6fc64a44-0c45-4eff-94d7-5b56f18d8cb2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:55.427476 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-6fc64a44-0c45-4eff-94d7-5b56f18d8cb2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:55.434257 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6fc64a44-0c45-4eff-94d7-5b56f18d8cb2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:55.434959 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6fc64a44-0c45-4eff-94d7-5b56f18d8cb2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:55.435441 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6fc64a44-0c45-4eff-94d7-5b56f18d8cb2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:55.436786 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6fc64a44-0c45-4eff-94d7-5b56f18d8cb2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:55.437239 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6fc64a44-0c45-4eff-94d7-5b56f18d8cb2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:55.437666 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6fc64a44-0c45-4eff-94d7-5b56f18d8cb2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:55.521676 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-71a679d6-326f-4bc9-89d3-abe7a30eae50 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:55.532703 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-71a679d6-326f-4bc9-89d3-abe7a30eae50 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1521 microversion: 2.1 time: 0.203423 Oct 19 00:40:55.533281 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 100/227] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:55 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:55.537978 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-f4da56d4-35ee-4540-a93b-db773999c564 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:55.538822 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-f4da56d4-35ee-4540-a93b-db773999c564 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] [instance: 27c84340-8c49-4f3f-8c36-eb1a2cdaa804] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:55.545769 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f4da56d4-35ee-4540-a93b-db773999c564 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:55.546683 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f4da56d4-35ee-4540-a93b-db773999c564 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:55.547357 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f4da56d4-35ee-4540-a93b-db773999c564 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:55.548306 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f4da56d4-35ee-4540-a93b-db773999c564 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:55.548959 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f4da56d4-35ee-4540-a93b-db773999c564 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:55.549659 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f4da56d4-35ee-4540-a93b-db773999c564 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:55.644749 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-6fc64a44-0c45-4eff-94d7-5b56f18d8cb2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:55.653545 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-6fc64a44-0c45-4eff-94d7-5b56f18d8cb2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1550 microversion: 2.1 time: 0.232656 Oct 19 00:40:55.654262 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 128/228] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:55 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1550 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:40:55.678070 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-87fc463f-d7ef-4bec-9c9c-fc68f544e10b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:55.678562 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-87fc463f-d7ef-4bec-9c9c-fc68f544e10b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:55.684773 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-87fc463f-d7ef-4bec-9c9c-fc68f544e10b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:55.685335 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-87fc463f-d7ef-4bec-9c9c-fc68f544e10b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:55.686381 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-87fc463f-d7ef-4bec-9c9c-fc68f544e10b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:55.687079 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-87fc463f-d7ef-4bec-9c9c-fc68f544e10b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:55.687534 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-87fc463f-d7ef-4bec-9c9c-fc68f544e10b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:55.687979 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-87fc463f-d7ef-4bec-9c9c-fc68f544e10b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:55.763958 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-f4da56d4-35ee-4540-a93b-db773999c564 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e5b2b9d844730bf0c955c1c47b582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78099a2acb31422095531592b7c2da20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:55.771585 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-f4da56d4-35ee-4540-a93b-db773999c564 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] 10.222.0.33 "GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804" status: 200 len: 1313 microversion: 2.1 time: 0.237111 Oct 19 00:40:55.772192 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 101/229] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:55 2022] GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:55.786259 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-87fc463f-d7ef-4bec-9c9c-fc68f544e10b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.112007 Oct 19 00:40:55.786843 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 129/230] 10.222.0.33 () {58 vars in 1275 bytes} [Wed Oct 19 00:40:55 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:40:55.847777 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-ce0e3ac6-88c1-4a90-8010-ade816a6e484 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:55.849085 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-ce0e3ac6-88c1-4a90-8010-ade816a6e484 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:55.855172 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ce0e3ac6-88c1-4a90-8010-ade816a6e484 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:55.855676 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ce0e3ac6-88c1-4a90-8010-ade816a6e484 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:55.856167 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ce0e3ac6-88c1-4a90-8010-ade816a6e484 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:55.856842 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ce0e3ac6-88c1-4a90-8010-ade816a6e484 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:55.857830 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ce0e3ac6-88c1-4a90-8010-ade816a6e484 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:55.858257 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ce0e3ac6-88c1-4a90-8010-ade816a6e484 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:56.255399 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-5bd3a743-f7a5-4eda-8768-c4580d17140e tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:56.256236 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-5bd3a743-f7a5-4eda-8768-c4580d17140e tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] [instance: da272379-872f-4ae8-b961-47c6c5a50738] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:56.262453 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5bd3a743-f7a5-4eda-8768-c4580d17140e tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:56.262935 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5bd3a743-f7a5-4eda-8768-c4580d17140e tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:56.263363 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5bd3a743-f7a5-4eda-8768-c4580d17140e tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:56.265141 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5bd3a743-f7a5-4eda-8768-c4580d17140e tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:56.265644 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5bd3a743-f7a5-4eda-8768-c4580d17140e tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:56.266234 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5bd3a743-f7a5-4eda-8768-c4580d17140e tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:56.449187 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-ce0e3ac6-88c1-4a90-8010-ade816a6e484 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda9dd9eb8d3446c96b0c702dd09d2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb46376a666496b896ad085315c58fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:56.459311 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-ce0e3ac6-88c1-4a90-8010-ade816a6e484 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641" status: 200 len: 1554 microversion: 2.1 time: 0.615463 Oct 19 00:40:56.459902 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 102/231] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:55 2022] GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 => generated 1554 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:56.499527 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-5bd3a743-f7a5-4eda-8768-c4580d17140e tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ed34d4b774af4821303c98872e6e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab0bf27d6c7415f9d3fc8f873a0607f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:56.507947 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-5bd3a743-f7a5-4eda-8768-c4580d17140e tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] 10.222.0.33 "GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738" status: 200 len: 1315 microversion: 2.1 time: 0.256401 Oct 19 00:40:56.508965 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 130/232] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:56 2022] GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:40:56.556213 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-76e38643-4f63-4e37-87c5-051351683cfb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:56.556831 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-76e38643-4f63-4e37-87c5-051351683cfb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:56.563265 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-76e38643-4f63-4e37-87c5-051351683cfb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:56.563826 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-76e38643-4f63-4e37-87c5-051351683cfb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:56.564292 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-76e38643-4f63-4e37-87c5-051351683cfb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:56.564991 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-76e38643-4f63-4e37-87c5-051351683cfb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:56.565658 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-76e38643-4f63-4e37-87c5-051351683cfb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:56.566267 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-76e38643-4f63-4e37-87c5-051351683cfb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:56.794490 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-557ac1e8-c34f-4772-8d93-6100ed426e09 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:56.795135 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-557ac1e8-c34f-4772-8d93-6100ed426e09 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] [instance: 27c84340-8c49-4f3f-8c36-eb1a2cdaa804] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:56.801037 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-557ac1e8-c34f-4772-8d93-6100ed426e09 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:56.801574 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-557ac1e8-c34f-4772-8d93-6100ed426e09 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:56.801950 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-557ac1e8-c34f-4772-8d93-6100ed426e09 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:56.802641 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-557ac1e8-c34f-4772-8d93-6100ed426e09 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:56.803108 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-557ac1e8-c34f-4772-8d93-6100ed426e09 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:56.803542 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-557ac1e8-c34f-4772-8d93-6100ed426e09 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:56.925411 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-76e38643-4f63-4e37-87c5-051351683cfb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:56.934193 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-76e38643-4f63-4e37-87c5-051351683cfb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1521 microversion: 2.1 time: 0.381909 Oct 19 00:40:56.936179 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 103/233] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:56 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1521 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:57.005498 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-557ac1e8-c34f-4772-8d93-6100ed426e09 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e5b2b9d844730bf0c955c1c47b582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78099a2acb31422095531592b7c2da20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:57.013364 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-557ac1e8-c34f-4772-8d93-6100ed426e09 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] 10.222.0.33 "GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804" status: 200 len: 1313 microversion: 2.1 time: 0.222672 Oct 19 00:40:57.014480 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 131/234] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:56 2022] GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:40:57.052707 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-ed942530-7af5-4a9c-b39f-7bb8a93a5f4e req-1a8bb591-9968-46f0-80c1-30bb454d27c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b669ea21-79c9-4f4c-aa6b-e6c0cec96641", "name": "network-vif-deleted", "tag": "c18fbf98-f795-40c5-946a-d03e103edc85"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:40:57.062733 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-ed942530-7af5-4a9c-b39f-7bb8a93a5f4e req-1a8bb591-9968-46f0-80c1-30bb454d27c7 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:57.063342 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-ed942530-7af5-4a9c-b39f-7bb8a93a5f4e req-1a8bb591-9968-46f0-80c1-30bb454d27c7 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:57.063775 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-ed942530-7af5-4a9c-b39f-7bb8a93a5f4e req-1a8bb591-9968-46f0-80c1-30bb454d27c7 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:57.075332 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-ed942530-7af5-4a9c-b39f-7bb8a93a5f4e req-1a8bb591-9968-46f0-80c1-30bb454d27c7 service nova] Creating event network-vif-deleted:c18fbf98-f795-40c5-946a-d03e103edc85 for instance b669ea21-79c9-4f4c-aa6b-e6c0cec96641 on hv-cinder-maste Oct 19 00:40:57.081006 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-ed942530-7af5-4a9c-b39f-7bb8a93a5f4e req-1a8bb591-9968-46f0-80c1-30bb454d27c7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032105 Oct 19 00:40:57.082120 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 104/235] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:40:57.483470 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-20e653be-7d41-4919-91e8-0bb352b774d3 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:57.484219 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-20e653be-7d41-4919-91e8-0bb352b774d3 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:57.490315 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-20e653be-7d41-4919-91e8-0bb352b774d3 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:57.490972 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-20e653be-7d41-4919-91e8-0bb352b774d3 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:57.491408 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-20e653be-7d41-4919-91e8-0bb352b774d3 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:57.492132 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-20e653be-7d41-4919-91e8-0bb352b774d3 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:57.492580 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-20e653be-7d41-4919-91e8-0bb352b774d3 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:57.493121 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-20e653be-7d41-4919-91e8-0bb352b774d3 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:57.506710 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-e951e653-b649-49b0-9c00-ef8c2e5ea68a req-af75a010-54c0-4ed0-831f-38a5987a1256 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f550e071-b7cd-4628-aff9-59e09cfcd654", "tag": "11a76c21-a751-4ca5-acc2-a510feda4607"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:40:57.517763 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-e951e653-b649-49b0-9c00-ef8c2e5ea68a req-af75a010-54c0-4ed0-831f-38a5987a1256 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:57.518391 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-e951e653-b649-49b0-9c00-ef8c2e5ea68a req-af75a010-54c0-4ed0-831f-38a5987a1256 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:57.518920 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-e951e653-b649-49b0-9c00-ef8c2e5ea68a req-af75a010-54c0-4ed0-831f-38a5987a1256 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:57.529356 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-20e653be-7d41-4919-91e8-0bb352b774d3 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:57.529859 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-20e653be-7d41-4919-91e8-0bb352b774d3 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:57.530280 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-20e653be-7d41-4919-91e8-0bb352b774d3 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:57.530741 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.objects.instance [None req-20e653be-7d41-4919-91e8-0bb352b774d3 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lazy-loading 'fault' on Instance uuid b669ea21-79c9-4f4c-aa6b-e6c0cec96641 {{(pid=125532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:40:57.531820 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-e951e653-b649-49b0-9c00-ef8c2e5ea68a req-af75a010-54c0-4ed0-831f-38a5987a1256 service nova] Creating event network-changed:11a76c21-a751-4ca5-acc2-a510feda4607 for instance f550e071-b7cd-4628-aff9-59e09cfcd654 on hv-cinder-maste Oct 19 00:40:57.537331 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-e951e653-b649-49b0-9c00-ef8c2e5ea68a req-af75a010-54c0-4ed0-831f-38a5987a1256 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034861 Oct 19 00:40:57.538212 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 105/236] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:40:57.544488 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-98fde840-7bcc-45f1-b707-806bdeae2d1e tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:57.545454 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-98fde840-7bcc-45f1-b707-806bdeae2d1e tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] [instance: da272379-872f-4ae8-b961-47c6c5a50738] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:57.552121 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-98fde840-7bcc-45f1-b707-806bdeae2d1e tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:57.552690 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-98fde840-7bcc-45f1-b707-806bdeae2d1e tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:57.553185 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-98fde840-7bcc-45f1-b707-806bdeae2d1e tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:57.554125 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-98fde840-7bcc-45f1-b707-806bdeae2d1e tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:57.554728 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-98fde840-7bcc-45f1-b707-806bdeae2d1e tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:57.555158 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-98fde840-7bcc-45f1-b707-806bdeae2d1e tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:57.579150 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-20e653be-7d41-4919-91e8-0bb352b774d3 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda9dd9eb8d3446c96b0c702dd09d2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb46376a666496b896ad085315c58fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:57.587304 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-20e653be-7d41-4919-91e8-0bb352b774d3 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641" status: 200 len: 1351 microversion: 2.1 time: 0.108473 Oct 19 00:40:57.587892 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 132/237] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:57 2022] GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 => generated 1351 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:57.691070 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-98fde840-7bcc-45f1-b707-806bdeae2d1e tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ed34d4b774af4821303c98872e6e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab0bf27d6c7415f9d3fc8f873a0607f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:57.699120 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-98fde840-7bcc-45f1-b707-806bdeae2d1e tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] 10.222.0.33 "GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738" status: 200 len: 1315 microversion: 2.1 time: 0.159556 Oct 19 00:40:57.699823 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 106/238] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:57 2022] GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:57.957824 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-b3e487ee-1d3c-4c26-a330-4e988b8c3ec8 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:57.958425 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-b3e487ee-1d3c-4c26-a330-4e988b8c3ec8 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:57.964465 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b3e487ee-1d3c-4c26-a330-4e988b8c3ec8 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:57.964942 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b3e487ee-1d3c-4c26-a330-4e988b8c3ec8 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:57.965371 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b3e487ee-1d3c-4c26-a330-4e988b8c3ec8 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:57.966056 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b3e487ee-1d3c-4c26-a330-4e988b8c3ec8 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:57.966877 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b3e487ee-1d3c-4c26-a330-4e988b8c3ec8 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:57.967000 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b3e487ee-1d3c-4c26-a330-4e988b8c3ec8 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:58.040040 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-6b564f86-a17a-45ae-a9c2-4aa74ad8074c tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:58.040654 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-6b564f86-a17a-45ae-a9c2-4aa74ad8074c tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] [instance: 27c84340-8c49-4f3f-8c36-eb1a2cdaa804] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:58.054205 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6b564f86-a17a-45ae-a9c2-4aa74ad8074c tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:58.057334 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6b564f86-a17a-45ae-a9c2-4aa74ad8074c tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:58.057927 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6b564f86-a17a-45ae-a9c2-4aa74ad8074c tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:58.060549 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6b564f86-a17a-45ae-a9c2-4aa74ad8074c tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:58.062602 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6b564f86-a17a-45ae-a9c2-4aa74ad8074c tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:58.063052 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6b564f86-a17a-45ae-a9c2-4aa74ad8074c tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:58.202508 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-b3e487ee-1d3c-4c26-a330-4e988b8c3ec8 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:58.211334 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-b3e487ee-1d3c-4c26-a330-4e988b8c3ec8 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1521 microversion: 2.1 time: 0.256832 Oct 19 00:40:58.212252 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 133/239] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:57 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:40:58.345198 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-6b564f86-a17a-45ae-a9c2-4aa74ad8074c tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e5b2b9d844730bf0c955c1c47b582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78099a2acb31422095531592b7c2da20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:58.353490 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-6b564f86-a17a-45ae-a9c2-4aa74ad8074c tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] 10.222.0.33 "GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804" status: 200 len: 1497 microversion: 2.1 time: 0.319119 Oct 19 00:40:58.354072 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 107/240] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:58 2022] GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804 => generated 1497 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:58.611411 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-4d14016c-5193-4cf2-8160-7489f2654e6b tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:58.612684 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-4d14016c-5193-4cf2-8160-7489f2654e6b tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:58.620654 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4d14016c-5193-4cf2-8160-7489f2654e6b tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:58.621222 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4d14016c-5193-4cf2-8160-7489f2654e6b tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:58.621731 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4d14016c-5193-4cf2-8160-7489f2654e6b tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:58.622515 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4d14016c-5193-4cf2-8160-7489f2654e6b tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:58.623154 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4d14016c-5193-4cf2-8160-7489f2654e6b tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:58.623650 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4d14016c-5193-4cf2-8160-7489f2654e6b tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:58.662612 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4d14016c-5193-4cf2-8160-7489f2654e6b tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:58.663394 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4d14016c-5193-4cf2-8160-7489f2654e6b tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:58.664173 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4d14016c-5193-4cf2-8160-7489f2654e6b tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:58.664838 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.objects.instance [None req-4d14016c-5193-4cf2-8160-7489f2654e6b tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lazy-loading 'fault' on Instance uuid b669ea21-79c9-4f4c-aa6b-e6c0cec96641 {{(pid=125532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:40:58.723290 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-f1a653dc-b423-4d39-b9d1-28f292fe0566 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:58.724012 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-f1a653dc-b423-4d39-b9d1-28f292fe0566 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] [instance: da272379-872f-4ae8-b961-47c6c5a50738] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:58.724450 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-4d14016c-5193-4cf2-8160-7489f2654e6b tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda9dd9eb8d3446c96b0c702dd09d2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb46376a666496b896ad085315c58fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:58.730720 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f1a653dc-b423-4d39-b9d1-28f292fe0566 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:58.731425 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f1a653dc-b423-4d39-b9d1-28f292fe0566 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:58.731819 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f1a653dc-b423-4d39-b9d1-28f292fe0566 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:58.732949 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f1a653dc-b423-4d39-b9d1-28f292fe0566 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:58.733583 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f1a653dc-b423-4d39-b9d1-28f292fe0566 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:58.734158 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f1a653dc-b423-4d39-b9d1-28f292fe0566 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:58.735549 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-4d14016c-5193-4cf2-8160-7489f2654e6b tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641" status: 200 len: 1351 microversion: 2.1 time: 0.128419 Oct 19 00:40:58.744668 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 134/241] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:58 2022] GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 => generated 1351 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:58.871483 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-f1a653dc-b423-4d39-b9d1-28f292fe0566 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ed34d4b774af4821303c98872e6e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab0bf27d6c7415f9d3fc8f873a0607f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:58.879958 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-f1a653dc-b423-4d39-b9d1-28f292fe0566 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] 10.222.0.33 "GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738" status: 200 len: 1315 microversion: 2.1 time: 0.160334 Oct 19 00:40:58.880841 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 108/242] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:58 2022] GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:59.235769 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-04ce168e-8f37-4d47-bb2c-df656a348cf0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:59.236332 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-04ce168e-8f37-4d47-bb2c-df656a348cf0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:59.242255 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-04ce168e-8f37-4d47-bb2c-df656a348cf0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:59.242733 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-04ce168e-8f37-4d47-bb2c-df656a348cf0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:59.243201 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-04ce168e-8f37-4d47-bb2c-df656a348cf0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:59.243932 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-04ce168e-8f37-4d47-bb2c-df656a348cf0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:59.244389 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-04ce168e-8f37-4d47-bb2c-df656a348cf0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:59.244808 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-04ce168e-8f37-4d47-bb2c-df656a348cf0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:59.372694 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-04ce168e-8f37-4d47-bb2c-df656a348cf0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:59.381194 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-04ce168e-8f37-4d47-bb2c-df656a348cf0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1521 microversion: 2.1 time: 0.150429 Oct 19 00:40:59.381756 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 135/243] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:59 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:59.758208 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-80989ac7-1d34-49a4-9cbb-a68197e8cf5a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:59.759430 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-80989ac7-1d34-49a4-9cbb-a68197e8cf5a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:59.766005 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-80989ac7-1d34-49a4-9cbb-a68197e8cf5a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:59.766484 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-80989ac7-1d34-49a4-9cbb-a68197e8cf5a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:59.766920 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-80989ac7-1d34-49a4-9cbb-a68197e8cf5a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:59.767608 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-80989ac7-1d34-49a4-9cbb-a68197e8cf5a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:59.768116 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-80989ac7-1d34-49a4-9cbb-a68197e8cf5a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:59.768551 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-80989ac7-1d34-49a4-9cbb-a68197e8cf5a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:59.800541 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-80989ac7-1d34-49a4-9cbb-a68197e8cf5a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:59.801025 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-80989ac7-1d34-49a4-9cbb-a68197e8cf5a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:59.801457 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-80989ac7-1d34-49a4-9cbb-a68197e8cf5a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:59.801899 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.objects.instance [None req-80989ac7-1d34-49a4-9cbb-a68197e8cf5a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lazy-loading 'fault' on Instance uuid b669ea21-79c9-4f4c-aa6b-e6c0cec96641 {{(pid=125531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:40:59.847512 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-80989ac7-1d34-49a4-9cbb-a68197e8cf5a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda9dd9eb8d3446c96b0c702dd09d2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb46376a666496b896ad085315c58fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:40:59.855924 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-80989ac7-1d34-49a4-9cbb-a68197e8cf5a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641" status: 200 len: 1351 microversion: 2.1 time: 0.101610 Oct 19 00:40:59.856495 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 109/244] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:59 2022] GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 => generated 1351 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:40:59.904583 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-b56ad68d-5bd5-4a8a-b941-9f3a737afc0f tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:40:59.905337 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-b56ad68d-5bd5-4a8a-b941-9f3a737afc0f tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] [instance: da272379-872f-4ae8-b961-47c6c5a50738] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:40:59.911024 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b56ad68d-5bd5-4a8a-b941-9f3a737afc0f tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:59.911501 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b56ad68d-5bd5-4a8a-b941-9f3a737afc0f tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:59.912011 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b56ad68d-5bd5-4a8a-b941-9f3a737afc0f tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:40:59.912659 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b56ad68d-5bd5-4a8a-b941-9f3a737afc0f tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:40:59.913112 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b56ad68d-5bd5-4a8a-b941-9f3a737afc0f tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:40:59.913535 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b56ad68d-5bd5-4a8a-b941-9f3a737afc0f tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:00.056888 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-b56ad68d-5bd5-4a8a-b941-9f3a737afc0f tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ed34d4b774af4821303c98872e6e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab0bf27d6c7415f9d3fc8f873a0607f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:00.064835 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-b56ad68d-5bd5-4a8a-b941-9f3a737afc0f tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] 10.222.0.33 "GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738" status: 200 len: 1315 microversion: 2.1 time: 0.164641 Oct 19 00:41:00.065219 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 136/245] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:40:59 2022] GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:00.403428 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-06b2c9b9-2983-4bd3-a2a0-f6d92f29fe23 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:00.404112 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-06b2c9b9-2983-4bd3-a2a0-f6d92f29fe23 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:00.410180 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-06b2c9b9-2983-4bd3-a2a0-f6d92f29fe23 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:00.410600 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-06b2c9b9-2983-4bd3-a2a0-f6d92f29fe23 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:00.411041 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-06b2c9b9-2983-4bd3-a2a0-f6d92f29fe23 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:00.411750 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-06b2c9b9-2983-4bd3-a2a0-f6d92f29fe23 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:00.412229 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-06b2c9b9-2983-4bd3-a2a0-f6d92f29fe23 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:00.412655 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-06b2c9b9-2983-4bd3-a2a0-f6d92f29fe23 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:00.545998 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-06b2c9b9-2983-4bd3-a2a0-f6d92f29fe23 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:00.554146 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-06b2c9b9-2983-4bd3-a2a0-f6d92f29fe23 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1521 microversion: 2.1 time: 0.154526 Oct 19 00:41:00.554793 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 110/246] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:00 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:00.879522 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-d332a3bc-6ccd-4c41-8c91-3f9cff8a3b8f tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:00.880482 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-d332a3bc-6ccd-4c41-8c91-3f9cff8a3b8f tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:00.886988 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d332a3bc-6ccd-4c41-8c91-3f9cff8a3b8f tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:00.887665 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d332a3bc-6ccd-4c41-8c91-3f9cff8a3b8f tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:00.888123 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d332a3bc-6ccd-4c41-8c91-3f9cff8a3b8f tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:00.888927 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d332a3bc-6ccd-4c41-8c91-3f9cff8a3b8f tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:00.889538 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d332a3bc-6ccd-4c41-8c91-3f9cff8a3b8f tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:00.889955 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d332a3bc-6ccd-4c41-8c91-3f9cff8a3b8f tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:00.921862 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d332a3bc-6ccd-4c41-8c91-3f9cff8a3b8f tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:00.922468 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d332a3bc-6ccd-4c41-8c91-3f9cff8a3b8f tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:00.922900 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d332a3bc-6ccd-4c41-8c91-3f9cff8a3b8f tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:00.923453 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.objects.instance [None req-d332a3bc-6ccd-4c41-8c91-3f9cff8a3b8f tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lazy-loading 'fault' on Instance uuid b669ea21-79c9-4f4c-aa6b-e6c0cec96641 {{(pid=125532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:41:00.937511 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-08dbb975-3a06-4a17-b594-3e8ece0b9f26 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:00.938033 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-08dbb975-3a06-4a17-b594-3e8ece0b9f26 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] [instance: 27c84340-8c49-4f3f-8c36-eb1a2cdaa804] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:00.944587 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-08dbb975-3a06-4a17-b594-3e8ece0b9f26 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:00.945068 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-08dbb975-3a06-4a17-b594-3e8ece0b9f26 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:00.945491 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-08dbb975-3a06-4a17-b594-3e8ece0b9f26 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:00.946212 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-08dbb975-3a06-4a17-b594-3e8ece0b9f26 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:00.946629 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-08dbb975-3a06-4a17-b594-3e8ece0b9f26 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:00.947044 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-08dbb975-3a06-4a17-b594-3e8ece0b9f26 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:00.963808 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-d332a3bc-6ccd-4c41-8c91-3f9cff8a3b8f tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda9dd9eb8d3446c96b0c702dd09d2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb46376a666496b896ad085315c58fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:00.972191 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-d332a3bc-6ccd-4c41-8c91-3f9cff8a3b8f tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641" status: 200 len: 1351 microversion: 2.1 time: 0.096624 Oct 19 00:41:00.972649 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-08dbb975-3a06-4a17-b594-3e8ece0b9f26 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] [instance: 27c84340-8c49-4f3f-8c36-eb1a2cdaa804] Going to try to terminate instance {{(pid=125531) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:41:00.972761 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 137/247] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:00 2022] GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 => generated 1351 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:01.055070 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-08dbb975-3a06-4a17-b594-3e8ece0b9f26 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] 10.222.0.33 "DELETE /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804" status: 204 len: 0 microversion: 2.1 time: 0.122269 Oct 19 00:41:01.055785 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 111/248] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Oct 19 00:41:00 2022] DELETE /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 00:41:01.064484 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-bc62ae3d-0108-47da-aa3c-c172f7100e9e tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:01.065134 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-bc62ae3d-0108-47da-aa3c-c172f7100e9e tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] [instance: 27c84340-8c49-4f3f-8c36-eb1a2cdaa804] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:01.071082 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-bc62ae3d-0108-47da-aa3c-c172f7100e9e tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:01.071553 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-bc62ae3d-0108-47da-aa3c-c172f7100e9e tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:01.072033 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-bc62ae3d-0108-47da-aa3c-c172f7100e9e tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:01.072709 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-bc62ae3d-0108-47da-aa3c-c172f7100e9e tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:01.073152 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-bc62ae3d-0108-47da-aa3c-c172f7100e9e tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:01.073564 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-bc62ae3d-0108-47da-aa3c-c172f7100e9e tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:01.087936 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-feec378c-a580-4bcc-893a-5b74c7a4f95a tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:01.088631 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-feec378c-a580-4bcc-893a-5b74c7a4f95a tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] [instance: da272379-872f-4ae8-b961-47c6c5a50738] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:01.094451 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-feec378c-a580-4bcc-893a-5b74c7a4f95a tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:01.094922 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-feec378c-a580-4bcc-893a-5b74c7a4f95a tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:01.095360 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-feec378c-a580-4bcc-893a-5b74c7a4f95a tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:01.096087 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-feec378c-a580-4bcc-893a-5b74c7a4f95a tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:01.096540 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-feec378c-a580-4bcc-893a-5b74c7a4f95a tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:01.096964 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-feec378c-a580-4bcc-893a-5b74c7a4f95a tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:01.201946 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-bc62ae3d-0108-47da-aa3c-c172f7100e9e tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e5b2b9d844730bf0c955c1c47b582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78099a2acb31422095531592b7c2da20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:01.209626 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-bc62ae3d-0108-47da-aa3c-c172f7100e9e tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] 10.222.0.33 "GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804" status: 200 len: 1503 microversion: 2.1 time: 0.149538 Oct 19 00:41:01.210191 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 138/249] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:01 2022] GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:01.256680 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-feec378c-a580-4bcc-893a-5b74c7a4f95a tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ed34d4b774af4821303c98872e6e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab0bf27d6c7415f9d3fc8f873a0607f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:01.259292 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:01.266564 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-feec378c-a580-4bcc-893a-5b74c7a4f95a tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] 10.222.0.33 "GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738" status: 200 len: 1315 microversion: 2.1 time: 0.182844 Oct 19 00:41:01.267139 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 112/250] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:01 2022] GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:41:01.578937 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-a34d8c93-ea6f-42e4-95a2-d61e0e1deb4e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:01.579669 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-a34d8c93-ea6f-42e4-95a2-d61e0e1deb4e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:01.585825 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a34d8c93-ea6f-42e4-95a2-d61e0e1deb4e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:01.586311 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a34d8c93-ea6f-42e4-95a2-d61e0e1deb4e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:01.586744 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a34d8c93-ea6f-42e4-95a2-d61e0e1deb4e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:01.587442 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a34d8c93-ea6f-42e4-95a2-d61e0e1deb4e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:01.587921 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a34d8c93-ea6f-42e4-95a2-d61e0e1deb4e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:01.588342 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a34d8c93-ea6f-42e4-95a2-d61e0e1deb4e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:01.723623 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-a34d8c93-ea6f-42e4-95a2-d61e0e1deb4e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:01.731225 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-a34d8c93-ea6f-42e4-95a2-d61e0e1deb4e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1521 microversion: 2.1 time: 0.156968 Oct 19 00:41:01.731787 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 139/251] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:01 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:01.996359 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-5ae09a0f-fdf0-4f30-9092-7b69e1e36ca0 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:01.996966 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-5ae09a0f-fdf0-4f30-9092-7b69e1e36ca0 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:02.001654 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:02.006569 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5ae09a0f-fdf0-4f30-9092-7b69e1e36ca0 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:02.007041 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5ae09a0f-fdf0-4f30-9092-7b69e1e36ca0 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:02.007501 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5ae09a0f-fdf0-4f30-9092-7b69e1e36ca0 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:02.008252 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5ae09a0f-fdf0-4f30-9092-7b69e1e36ca0 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:02.008700 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5ae09a0f-fdf0-4f30-9092-7b69e1e36ca0 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:02.009110 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5ae09a0f-fdf0-4f30-9092-7b69e1e36ca0 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:02.045848 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5ae09a0f-fdf0-4f30-9092-7b69e1e36ca0 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:02.046317 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5ae09a0f-fdf0-4f30-9092-7b69e1e36ca0 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:02.046743 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5ae09a0f-fdf0-4f30-9092-7b69e1e36ca0 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:02.047178 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.objects.instance [None req-5ae09a0f-fdf0-4f30-9092-7b69e1e36ca0 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lazy-loading 'fault' on Instance uuid b669ea21-79c9-4f4c-aa6b-e6c0cec96641 {{(pid=125531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:41:02.087246 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-5ae09a0f-fdf0-4f30-9092-7b69e1e36ca0 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda9dd9eb8d3446c96b0c702dd09d2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb46376a666496b896ad085315c58fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:02.095384 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-5ae09a0f-fdf0-4f30-9092-7b69e1e36ca0 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641" status: 200 len: 1351 microversion: 2.1 time: 0.103399 Oct 19 00:41:02.096023 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 113/252] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:01 2022] GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 => generated 1351 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:02.234061 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-d2081937-0c14-4fc0-a749-102620fc1352 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:02.234588 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-d2081937-0c14-4fc0-a749-102620fc1352 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] [instance: 27c84340-8c49-4f3f-8c36-eb1a2cdaa804] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:02.240804 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d2081937-0c14-4fc0-a749-102620fc1352 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:02.241281 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d2081937-0c14-4fc0-a749-102620fc1352 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:02.241715 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d2081937-0c14-4fc0-a749-102620fc1352 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:02.242431 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d2081937-0c14-4fc0-a749-102620fc1352 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:02.242890 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d2081937-0c14-4fc0-a749-102620fc1352 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:02.243305 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d2081937-0c14-4fc0-a749-102620fc1352 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:02.289798 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-e8f16e62-864e-4838-934b-6898ee302309 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:02.290472 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-e8f16e62-864e-4838-934b-6898ee302309 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] [instance: da272379-872f-4ae8-b961-47c6c5a50738] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:02.297317 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e8f16e62-864e-4838-934b-6898ee302309 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:02.298171 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e8f16e62-864e-4838-934b-6898ee302309 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:02.298317 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e8f16e62-864e-4838-934b-6898ee302309 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:02.298975 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e8f16e62-864e-4838-934b-6898ee302309 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:02.299434 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e8f16e62-864e-4838-934b-6898ee302309 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:02.299904 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e8f16e62-864e-4838-934b-6898ee302309 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:02.381018 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-d2081937-0c14-4fc0-a749-102620fc1352 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e5b2b9d844730bf0c955c1c47b582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78099a2acb31422095531592b7c2da20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:02.389847 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-d2081937-0c14-4fc0-a749-102620fc1352 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] 10.222.0.33 "GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804" status: 200 len: 1503 microversion: 2.1 time: 0.160248 Oct 19 00:41:02.390432 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 140/253] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:02 2022] GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:02.565781 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-e8f16e62-864e-4838-934b-6898ee302309 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ed34d4b774af4821303c98872e6e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab0bf27d6c7415f9d3fc8f873a0607f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:02.573465 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-e8f16e62-864e-4838-934b-6898ee302309 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] 10.222.0.33 "GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738" status: 200 len: 1315 microversion: 2.1 time: 0.287505 Oct 19 00:41:02.574024 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 114/254] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:02 2022] GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:41:02.755642 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-be9a55fb-6197-471a-836f-43d2e4e39182 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:02.756278 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-be9a55fb-6197-471a-836f-43d2e4e39182 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:02.762592 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-be9a55fb-6197-471a-836f-43d2e4e39182 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:02.763075 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-be9a55fb-6197-471a-836f-43d2e4e39182 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:02.763505 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-be9a55fb-6197-471a-836f-43d2e4e39182 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:02.764228 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-be9a55fb-6197-471a-836f-43d2e4e39182 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:02.764685 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-be9a55fb-6197-471a-836f-43d2e4e39182 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:02.765110 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-be9a55fb-6197-471a-836f-43d2e4e39182 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:02.915129 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-be9a55fb-6197-471a-836f-43d2e4e39182 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:02.923563 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-be9a55fb-6197-471a-836f-43d2e4e39182 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1521 microversion: 2.1 time: 0.171704 Oct 19 00:41:02.924239 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 141/255] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:02 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:03.118232 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-c97dd19c-98d3-4f9b-a862-0416f22c126a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:03.118741 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-c97dd19c-98d3-4f9b-a862-0416f22c126a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:03.125436 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c97dd19c-98d3-4f9b-a862-0416f22c126a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:03.125917 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c97dd19c-98d3-4f9b-a862-0416f22c126a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:03.126348 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c97dd19c-98d3-4f9b-a862-0416f22c126a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:03.127032 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c97dd19c-98d3-4f9b-a862-0416f22c126a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:03.127482 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c97dd19c-98d3-4f9b-a862-0416f22c126a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:03.127938 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c97dd19c-98d3-4f9b-a862-0416f22c126a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:03.141802 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.wsgi [None req-c97dd19c-98d3-4f9b-a862-0416f22c126a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] HTTP exception thrown: Instance b669ea21-79c9-4f4c-aa6b-e6c0cec96641 could not be found. Oct 19 00:41:03.146293 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-c97dd19c-98d3-4f9b-a862-0416f22c126a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Request method failure captured: Oct 19 00:41:03.146293 dv-cinder-master-3-smb devstack@n-api.service[125531]: request: GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 HTTP/1.1 Oct 19 00:41:03.146293 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept: application/json Oct 19 00:41:03.146293 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept-Encoding: identity Oct 19 00:41:03.146293 dv-cinder-master-3-smb devstack@n-api.service[125531]: Connection: close Oct 19 00:41:03.146293 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Length: 0 Oct 19 00:41:03.146293 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Type: application/json Oct 19 00:41:03.146293 dv-cinder-master-3-smb devstack@n-api.service[125531]: Host: 10.222.0.33 Oct 19 00:41:03.146293 dv-cinder-master-3-smb devstack@n-api.service[125531]: Openstack-System-Scope: None Oct 19 00:41:03.146293 dv-cinder-master-3-smb devstack@n-api.service[125531]: User-Agent: python-urllib3/1.26.12 Oct 19 00:41:03.146293 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Auth-Token: gAAAAABjT0dWecACzOpVYkDL046EGTuzeHPGdB47Sw_w0bNv-m_0Y1ki5hdqIbLjUPsQZaS_qeZENfCRECvgTcNhR7HQBRawV3NUR2uh8QnxNIRd5alhPQOpp2GANK2gjfocLFO5HQrf-d-tupnMPAzBHpuQ9t49OJYl7-K6O-FBS4WWfEmy8to Oct 19 00:41:03.146293 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Id: None Oct 19 00:41:03.146293 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Name: None Oct 19 00:41:03.146293 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Identity-Status: Confirmed Oct 19 00:41:03.146293 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Is-Admin-Project: True Oct 19 00:41:03.146293 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Id: default Oct 19 00:41:03.146293 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Name: Default Oct 19 00:41:03.146293 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Id: dfb46376a666496b896ad085315c58fd Oct 19 00:41:03.146293 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Name: tempest-DeleteServersTestJSON-1444479242 Oct 19 00:41:03.146293 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Role: member,reader Oct 19 00:41:03.146293 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Roles: member,reader Oct 19 00:41:03.147784 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dfb46376a666496b896ad085315c58fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dfb46376a666496b896ad085315c58fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dfb46376a666496b896ad085315c58fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dfb46376a666496b896ad085315c58fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:41:03.147784 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant: tempest-DeleteServersTestJSON-1444479242 Oct 19 00:41:03.147784 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Id: dfb46376a666496b896ad085315c58fd Oct 19 00:41:03.147784 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Name: tempest-DeleteServersTestJSON-1444479242 Oct 19 00:41:03.147784 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User: tempest-DeleteServersTestJSON-1444479242-project Oct 19 00:41:03.147784 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Id: default Oct 19 00:41:03.147784 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Name: Default Oct 19 00:41:03.147784 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Id: dda9dd9eb8d3446c96b0c702dd09d2fa Oct 19 00:41:03.147784 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Name: tempest-DeleteServersTestJSON-1444479242-project Oct 19 00:41:03.147784 dv-cinder-master-3-smb devstack@n-api.service[125531]: method: > Oct 19 00:41:03.147784 dv-cinder-master-3-smb devstack@n-api.service[125531]: exception: Instance b669ea21-79c9-4f4c-aa6b-e6c0cec96641 could not be found. Oct 19 00:41:03.147784 dv-cinder-master-3-smb devstack@n-api.service[125531]: action_args: {'id': 'b669ea21-79c9-4f4c-aa6b-e6c0cec96641'} Oct 19 00:41:03.148765 dv-cinder-master-3-smb devstack@n-api.service[125531]: {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:41:03.148765 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:41:03.148765 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:41:03.148765 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:41:03.148765 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:41:03.148765 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:41:03.148765 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:41:03.148765 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:41:03.148765 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:41:03.148765 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:41:03.148765 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b669ea21-79c9-4f4c-aa6b-e6c0cec96641 could not be found. Oct 19 00:41:03.148765 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:41:03.148765 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:41:03.148765 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:41:03.148765 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:41:03.148765 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:41:03.148765 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:41:03.148765 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:41:03.148765 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:41:03.148765 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:41:03.150159 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:41:03.150159 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:41:03.150159 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:41:03.150159 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:41:03.150159 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:41:03.150159 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:41:03.150159 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:41:03.150159 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b669ea21-79c9-4f4c-aa6b-e6c0cec96641 could not be found. Oct 19 00:41:03.150159 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:41:03.150159 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:41:03.150159 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:41:03.150159 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:41:03.150159 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:41:03.150159 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:41:03.150159 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:41:03.150159 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:41:03.150159 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b669ea21-79c9-4f4c-aa6b-e6c0cec96641 could not be found. Oct 19 00:41:03.150159 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:41:03.151381 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-c97dd19c-98d3-4f9b-a862-0416f22c126a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Returning 404 to user: Instance b669ea21-79c9-4f4c-aa6b-e6c0cec96641 could not be found. {{(pid=125531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:41:03.151381 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-c97dd19c-98d3-4f9b-a862-0416f22c126a tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641" status: 404 len: 111 microversion: 2.1 time: 0.033560 Oct 19 00:41:03.151381 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 115/256] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:03 2022] GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:41:03.260773 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-f87ae12f-f0aa-4c0b-96d2-fdf98bd3c408 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:03.262990 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-f87ae12f-f0aa-4c0b-96d2-fdf98bd3c408 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:03.270176 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f87ae12f-f0aa-4c0b-96d2-fdf98bd3c408 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:03.270743 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f87ae12f-f0aa-4c0b-96d2-fdf98bd3c408 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:03.271259 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f87ae12f-f0aa-4c0b-96d2-fdf98bd3c408 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:03.272072 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f87ae12f-f0aa-4c0b-96d2-fdf98bd3c408 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:03.272603 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f87ae12f-f0aa-4c0b-96d2-fdf98bd3c408 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:03.273103 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f87ae12f-f0aa-4c0b-96d2-fdf98bd3c408 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:03.286667 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.wsgi [None req-f87ae12f-f0aa-4c0b-96d2-fdf98bd3c408 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] HTTP exception thrown: Instance b669ea21-79c9-4f4c-aa6b-e6c0cec96641 could not be found. Oct 19 00:41:03.290732 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-f87ae12f-f0aa-4c0b-96d2-fdf98bd3c408 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Request method failure captured: Oct 19 00:41:03.290732 dv-cinder-master-3-smb devstack@n-api.service[125532]: request: GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641/os-volume_attachments HTTP/1.1 Oct 19 00:41:03.290732 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept: application/json Oct 19 00:41:03.290732 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept-Encoding: identity Oct 19 00:41:03.290732 dv-cinder-master-3-smb devstack@n-api.service[125532]: Connection: close Oct 19 00:41:03.290732 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Length: 0 Oct 19 00:41:03.290732 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Type: application/json Oct 19 00:41:03.290732 dv-cinder-master-3-smb devstack@n-api.service[125532]: Host: 10.222.0.33 Oct 19 00:41:03.290732 dv-cinder-master-3-smb devstack@n-api.service[125532]: Openstack-System-Scope: None Oct 19 00:41:03.290732 dv-cinder-master-3-smb devstack@n-api.service[125532]: User-Agent: python-urllib3/1.26.12 Oct 19 00:41:03.290732 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Auth-Token: gAAAAABjT0dWecACzOpVYkDL046EGTuzeHPGdB47Sw_w0bNv-m_0Y1ki5hdqIbLjUPsQZaS_qeZENfCRECvgTcNhR7HQBRawV3NUR2uh8QnxNIRd5alhPQOpp2GANK2gjfocLFO5HQrf-d-tupnMPAzBHpuQ9t49OJYl7-K6O-FBS4WWfEmy8to Oct 19 00:41:03.290732 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Id: None Oct 19 00:41:03.290732 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Name: None Oct 19 00:41:03.290732 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Identity-Status: Confirmed Oct 19 00:41:03.290732 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Is-Admin-Project: True Oct 19 00:41:03.290732 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Id: default Oct 19 00:41:03.290732 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Name: Default Oct 19 00:41:03.290732 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Id: dfb46376a666496b896ad085315c58fd Oct 19 00:41:03.290732 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Name: tempest-DeleteServersTestJSON-1444479242 Oct 19 00:41:03.290732 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Role: member,reader Oct 19 00:41:03.290732 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Roles: member,reader Oct 19 00:41:03.292185 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dfb46376a666496b896ad085315c58fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dfb46376a666496b896ad085315c58fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dfb46376a666496b896ad085315c58fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dfb46376a666496b896ad085315c58fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:41:03.292185 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant: tempest-DeleteServersTestJSON-1444479242 Oct 19 00:41:03.292185 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Id: dfb46376a666496b896ad085315c58fd Oct 19 00:41:03.292185 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Name: tempest-DeleteServersTestJSON-1444479242 Oct 19 00:41:03.292185 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User: tempest-DeleteServersTestJSON-1444479242-project Oct 19 00:41:03.292185 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Id: default Oct 19 00:41:03.292185 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Name: Default Oct 19 00:41:03.292185 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Id: dda9dd9eb8d3446c96b0c702dd09d2fa Oct 19 00:41:03.292185 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Name: tempest-DeleteServersTestJSON-1444479242-project Oct 19 00:41:03.292185 dv-cinder-master-3-smb devstack@n-api.service[125532]: method: > Oct 19 00:41:03.292185 dv-cinder-master-3-smb devstack@n-api.service[125532]: exception: Instance b669ea21-79c9-4f4c-aa6b-e6c0cec96641 could not be found. Oct 19 00:41:03.292185 dv-cinder-master-3-smb devstack@n-api.service[125532]: action_args: {'server_id': 'b669ea21-79c9-4f4c-aa6b-e6c0cec96641'} Oct 19 00:41:03.293116 dv-cinder-master-3-smb devstack@n-api.service[125532]: {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:41:03.293116 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:41:03.293116 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:41:03.293116 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:41:03.293116 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:41:03.293116 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:41:03.293116 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:41:03.293116 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:41:03.293116 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:41:03.293116 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:41:03.293116 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b669ea21-79c9-4f4c-aa6b-e6c0cec96641 could not be found. Oct 19 00:41:03.293116 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:03.293116 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:41:03.293116 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:03.293116 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:41:03.293116 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:41:03.293116 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:41:03.293116 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:41:03.293116 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:41:03.293116 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:41:03.294520 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:41:03.294520 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 00:41:03.294520 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:41:03.294520 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 00:41:03.294520 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:41:03.294520 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 19 00:41:03.294520 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 19 00:41:03.294520 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:41:03.294520 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:41:03.294520 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b669ea21-79c9-4f4c-aa6b-e6c0cec96641 could not be found. Oct 19 00:41:03.294520 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:03.294520 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:41:03.294520 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:03.294520 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:41:03.294520 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:41:03.294520 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:41:03.294520 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:41:03.294520 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:41:03.294520 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b669ea21-79c9-4f4c-aa6b-e6c0cec96641 could not be found. Oct 19 00:41:03.294520 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:03.296469 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-f87ae12f-f0aa-4c0b-96d2-fdf98bd3c408 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Returning 404 to user: Instance b669ea21-79c9-4f4c-aa6b-e6c0cec96641 could not be found. {{(pid=125532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:41:03.296469 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-f87ae12f-f0aa-4c0b-96d2-fdf98bd3c408 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036227 Oct 19 00:41:03.296469 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 142/257] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Oct 19 00:41:03 2022] GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:41:03.413123 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-f244c54d-d5d6-4d39-add2-fbc8740151c1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:03.413734 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-f244c54d-d5d6-4d39-add2-fbc8740151c1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] [instance: 27c84340-8c49-4f3f-8c36-eb1a2cdaa804] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:03.419719 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f244c54d-d5d6-4d39-add2-fbc8740151c1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:03.420233 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f244c54d-d5d6-4d39-add2-fbc8740151c1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:03.420842 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f244c54d-d5d6-4d39-add2-fbc8740151c1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:03.421413 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f244c54d-d5d6-4d39-add2-fbc8740151c1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:03.421867 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f244c54d-d5d6-4d39-add2-fbc8740151c1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:03.422277 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f244c54d-d5d6-4d39-add2-fbc8740151c1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:03.595997 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-e8ad80f2-c91d-4735-aef1-00a85765a824 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:03.596712 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-e8ad80f2-c91d-4735-aef1-00a85765a824 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] [instance: da272379-872f-4ae8-b961-47c6c5a50738] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:03.602684 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e8ad80f2-c91d-4735-aef1-00a85765a824 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:03.603164 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e8ad80f2-c91d-4735-aef1-00a85765a824 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:03.603595 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e8ad80f2-c91d-4735-aef1-00a85765a824 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:03.604312 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e8ad80f2-c91d-4735-aef1-00a85765a824 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:03.604762 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e8ad80f2-c91d-4735-aef1-00a85765a824 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:03.605351 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e8ad80f2-c91d-4735-aef1-00a85765a824 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:03.653923 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-f244c54d-d5d6-4d39-add2-fbc8740151c1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e5b2b9d844730bf0c955c1c47b582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78099a2acb31422095531592b7c2da20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:03.662065 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-f244c54d-d5d6-4d39-add2-fbc8740151c1 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] 10.222.0.33 "GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804" status: 200 len: 1503 microversion: 2.1 time: 0.252822 Oct 19 00:41:03.662668 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 116/258] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:03 2022] GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804 => generated 1503 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:03.763067 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-e8ad80f2-c91d-4735-aef1-00a85765a824 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ed34d4b774af4821303c98872e6e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab0bf27d6c7415f9d3fc8f873a0607f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:03.771758 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-e8ad80f2-c91d-4735-aef1-00a85765a824 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] 10.222.0.33 "GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738" status: 200 len: 1315 microversion: 2.1 time: 0.179310 Oct 19 00:41:03.786841 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 143/259] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:03 2022] GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:03.924319 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-cf0aa206-08c4-4cc6-919c-53e4d888e2e4 req-0fec4496-2ff8-4878-a88e-1f619e08e74d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da272379-872f-4ae8-b961-47c6c5a50738", "name": "network-vif-plugged", "status": "completed", "tag": "5918f28b-5dd0-4997-a671-7857d13d7fd3"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:41:03.934836 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-cf0aa206-08c4-4cc6-919c-53e4d888e2e4 req-0fec4496-2ff8-4878-a88e-1f619e08e74d service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:03.935431 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-cf0aa206-08c4-4cc6-919c-53e4d888e2e4 req-0fec4496-2ff8-4878-a88e-1f619e08e74d service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:03.935906 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-cf0aa206-08c4-4cc6-919c-53e4d888e2e4 req-0fec4496-2ff8-4878-a88e-1f619e08e74d service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:03.946794 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-554988f7-882f-474d-a0a1-9421e866d471 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:03.947603 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-554988f7-882f-474d-a0a1-9421e866d471 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:03.955347 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-554988f7-882f-474d-a0a1-9421e866d471 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:03.955838 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-554988f7-882f-474d-a0a1-9421e866d471 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:03.956293 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-554988f7-882f-474d-a0a1-9421e866d471 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:03.956999 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-554988f7-882f-474d-a0a1-9421e866d471 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:03.964221 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-cf0aa206-08c4-4cc6-919c-53e4d888e2e4 req-0fec4496-2ff8-4878-a88e-1f619e08e74d service nova] Creating event network-vif-plugged:5918f28b-5dd0-4997-a671-7857d13d7fd3 for instance da272379-872f-4ae8-b961-47c6c5a50738 on hv-cinder-maste Oct 19 00:41:03.965285 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-554988f7-882f-474d-a0a1-9421e866d471 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:03.966063 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-554988f7-882f-474d-a0a1-9421e866d471 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:03.976406 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-cf0aa206-08c4-4cc6-919c-53e4d888e2e4 req-0fec4496-2ff8-4878-a88e-1f619e08e74d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056225 Oct 19 00:41:03.977605 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 117/260] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:41:03.994120 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell1:SELECT=100 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:04.145949 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-554988f7-882f-474d-a0a1-9421e866d471 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:04.156427 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-554988f7-882f-474d-a0a1-9421e866d471 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1521 microversion: 2.1 time: 0.213685 Oct 19 00:41:04.157296 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 144/261] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:03 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:04.327566 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-8666fc8d-bcff-4184-9ed5-d43c1c8837a6 req-23f927e4-7793-47da-b29a-a99c8b598f07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27c84340-8c49-4f3f-8c36-eb1a2cdaa804", "name": "network-vif-deleted", "tag": "374201f0-520a-464b-a895-e94e0d2f5296"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:41:04.337053 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-8666fc8d-bcff-4184-9ed5-d43c1c8837a6 req-23f927e4-7793-47da-b29a-a99c8b598f07 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:04.337535 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-8666fc8d-bcff-4184-9ed5-d43c1c8837a6 req-23f927e4-7793-47da-b29a-a99c8b598f07 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:04.337974 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-8666fc8d-bcff-4184-9ed5-d43c1c8837a6 req-23f927e4-7793-47da-b29a-a99c8b598f07 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:04.349130 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-8666fc8d-bcff-4184-9ed5-d43c1c8837a6 req-23f927e4-7793-47da-b29a-a99c8b598f07 service nova] Creating event network-vif-deleted:374201f0-520a-464b-a895-e94e0d2f5296 for instance 27c84340-8c49-4f3f-8c36-eb1a2cdaa804 on hv-cinder-maste Oct 19 00:41:04.353888 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-8666fc8d-bcff-4184-9ed5-d43c1c8837a6 req-23f927e4-7793-47da-b29a-a99c8b598f07 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032041 Oct 19 00:41:04.354452 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 118/262] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:41:04.496030 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-01c61c41-e028-4402-93ed-6e484352169d tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:04.496582 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-01c61c41-e028-4402-93ed-6e484352169d tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:04.502740 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-01c61c41-e028-4402-93ed-6e484352169d tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:04.503226 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-01c61c41-e028-4402-93ed-6e484352169d tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:04.503688 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-01c61c41-e028-4402-93ed-6e484352169d tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:04.504419 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-01c61c41-e028-4402-93ed-6e484352169d tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:04.504860 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-01c61c41-e028-4402-93ed-6e484352169d tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:04.505287 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-01c61c41-e028-4402-93ed-6e484352169d tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:04.519018 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.wsgi [None req-01c61c41-e028-4402-93ed-6e484352169d tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] HTTP exception thrown: Instance b669ea21-79c9-4f4c-aa6b-e6c0cec96641 could not be found. Oct 19 00:41:04.521290 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-01c61c41-e028-4402-93ed-6e484352169d tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Request method failure captured: Oct 19 00:41:04.521290 dv-cinder-master-3-smb devstack@n-api.service[125532]: request: DELETE /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 HTTP/1.1 Oct 19 00:41:04.521290 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept: application/json Oct 19 00:41:04.521290 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept-Encoding: identity Oct 19 00:41:04.521290 dv-cinder-master-3-smb devstack@n-api.service[125532]: Connection: close Oct 19 00:41:04.521290 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Length: 0 Oct 19 00:41:04.521290 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Type: application/json Oct 19 00:41:04.521290 dv-cinder-master-3-smb devstack@n-api.service[125532]: Host: 10.222.0.33 Oct 19 00:41:04.521290 dv-cinder-master-3-smb devstack@n-api.service[125532]: Openstack-System-Scope: None Oct 19 00:41:04.521290 dv-cinder-master-3-smb devstack@n-api.service[125532]: User-Agent: python-urllib3/1.26.12 Oct 19 00:41:04.521290 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Auth-Token: gAAAAABjT0dWecACzOpVYkDL046EGTuzeHPGdB47Sw_w0bNv-m_0Y1ki5hdqIbLjUPsQZaS_qeZENfCRECvgTcNhR7HQBRawV3NUR2uh8QnxNIRd5alhPQOpp2GANK2gjfocLFO5HQrf-d-tupnMPAzBHpuQ9t49OJYl7-K6O-FBS4WWfEmy8to Oct 19 00:41:04.521290 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Id: None Oct 19 00:41:04.521290 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Name: None Oct 19 00:41:04.521290 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Identity-Status: Confirmed Oct 19 00:41:04.521290 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Is-Admin-Project: True Oct 19 00:41:04.521290 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Id: default Oct 19 00:41:04.521290 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Name: Default Oct 19 00:41:04.521290 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Id: dfb46376a666496b896ad085315c58fd Oct 19 00:41:04.521290 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Name: tempest-DeleteServersTestJSON-1444479242 Oct 19 00:41:04.521290 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Role: member,reader Oct 19 00:41:04.521290 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Roles: member,reader Oct 19 00:41:04.522429 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dfb46376a666496b896ad085315c58fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dfb46376a666496b896ad085315c58fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dfb46376a666496b896ad085315c58fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dfb46376a666496b896ad085315c58fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:41:04.522429 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant: tempest-DeleteServersTestJSON-1444479242 Oct 19 00:41:04.522429 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Id: dfb46376a666496b896ad085315c58fd Oct 19 00:41:04.522429 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Name: tempest-DeleteServersTestJSON-1444479242 Oct 19 00:41:04.522429 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User: tempest-DeleteServersTestJSON-1444479242-project Oct 19 00:41:04.522429 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Id: default Oct 19 00:41:04.522429 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Name: Default Oct 19 00:41:04.522429 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Id: dda9dd9eb8d3446c96b0c702dd09d2fa Oct 19 00:41:04.522429 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Name: tempest-DeleteServersTestJSON-1444479242-project Oct 19 00:41:04.522429 dv-cinder-master-3-smb devstack@n-api.service[125532]: method: > Oct 19 00:41:04.522429 dv-cinder-master-3-smb devstack@n-api.service[125532]: exception: Instance b669ea21-79c9-4f4c-aa6b-e6c0cec96641 could not be found. Oct 19 00:41:04.522429 dv-cinder-master-3-smb devstack@n-api.service[125532]: action_args: {'id': 'b669ea21-79c9-4f4c-aa6b-e6c0cec96641'} Oct 19 00:41:04.523068 dv-cinder-master-3-smb devstack@n-api.service[125532]: {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:41:04.523068 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:41:04.523068 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:41:04.523068 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:41:04.523068 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:41:04.523068 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:41:04.523068 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:41:04.523068 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:41:04.523068 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:41:04.523068 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:41:04.523068 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b669ea21-79c9-4f4c-aa6b-e6c0cec96641 could not be found. Oct 19 00:41:04.523068 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:04.523068 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:41:04.523068 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:04.523068 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:41:04.523068 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:41:04.523068 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:41:04.523068 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:41:04.523068 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:41:04.523068 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:41:04.524191 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:41:04.524191 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 00:41:04.524191 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 00:41:04.524191 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 00:41:04.524191 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 00:41:04.524191 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:41:04.524191 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:41:04.524191 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:41:04.524191 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:41:04.524191 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b669ea21-79c9-4f4c-aa6b-e6c0cec96641 could not be found. Oct 19 00:41:04.524191 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:04.524191 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:41:04.524191 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:04.524191 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:41:04.524191 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:41:04.524191 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:41:04.524191 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:41:04.524191 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:41:04.524191 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b669ea21-79c9-4f4c-aa6b-e6c0cec96641 could not be found. Oct 19 00:41:04.524191 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:04.525303 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-01c61c41-e028-4402-93ed-6e484352169d tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Returning 404 to user: Instance b669ea21-79c9-4f4c-aa6b-e6c0cec96641 could not be found. {{(pid=125532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:41:04.525303 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-01c61c41-e028-4402-93ed-6e484352169d tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641" status: 404 len: 111 microversion: 2.1 time: 0.030725 Oct 19 00:41:04.525303 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 145/263] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Oct 19 00:41:04 2022] DELETE /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:41:04.532379 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-681a8a71-7c96-499e-b8a2-0c1be302bc32 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:04.533079 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-681a8a71-7c96-499e-b8a2-0c1be302bc32 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] [instance: b669ea21-79c9-4f4c-aa6b-e6c0cec96641] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:04.539106 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-681a8a71-7c96-499e-b8a2-0c1be302bc32 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:04.539586 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-681a8a71-7c96-499e-b8a2-0c1be302bc32 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:04.540056 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-681a8a71-7c96-499e-b8a2-0c1be302bc32 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:04.540748 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-681a8a71-7c96-499e-b8a2-0c1be302bc32 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:04.541203 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-681a8a71-7c96-499e-b8a2-0c1be302bc32 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:04.541624 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-681a8a71-7c96-499e-b8a2-0c1be302bc32 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:04.554545 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.wsgi [None req-681a8a71-7c96-499e-b8a2-0c1be302bc32 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] HTTP exception thrown: Instance b669ea21-79c9-4f4c-aa6b-e6c0cec96641 could not be found. Oct 19 00:41:04.556176 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-681a8a71-7c96-499e-b8a2-0c1be302bc32 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Request method failure captured: Oct 19 00:41:04.556176 dv-cinder-master-3-smb devstack@n-api.service[125531]: request: GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 HTTP/1.1 Oct 19 00:41:04.556176 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept: application/json Oct 19 00:41:04.556176 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept-Encoding: identity Oct 19 00:41:04.556176 dv-cinder-master-3-smb devstack@n-api.service[125531]: Connection: close Oct 19 00:41:04.556176 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Length: 0 Oct 19 00:41:04.556176 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Type: application/json Oct 19 00:41:04.556176 dv-cinder-master-3-smb devstack@n-api.service[125531]: Host: 10.222.0.33 Oct 19 00:41:04.556176 dv-cinder-master-3-smb devstack@n-api.service[125531]: Openstack-System-Scope: None Oct 19 00:41:04.556176 dv-cinder-master-3-smb devstack@n-api.service[125531]: User-Agent: python-urllib3/1.26.12 Oct 19 00:41:04.556176 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Auth-Token: gAAAAABjT0dWecACzOpVYkDL046EGTuzeHPGdB47Sw_w0bNv-m_0Y1ki5hdqIbLjUPsQZaS_qeZENfCRECvgTcNhR7HQBRawV3NUR2uh8QnxNIRd5alhPQOpp2GANK2gjfocLFO5HQrf-d-tupnMPAzBHpuQ9t49OJYl7-K6O-FBS4WWfEmy8to Oct 19 00:41:04.556176 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Id: None Oct 19 00:41:04.556176 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Name: None Oct 19 00:41:04.556176 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Identity-Status: Confirmed Oct 19 00:41:04.556176 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Is-Admin-Project: True Oct 19 00:41:04.556176 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Id: default Oct 19 00:41:04.556176 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Name: Default Oct 19 00:41:04.556176 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Id: dfb46376a666496b896ad085315c58fd Oct 19 00:41:04.556176 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Name: tempest-DeleteServersTestJSON-1444479242 Oct 19 00:41:04.556176 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Role: member,reader Oct 19 00:41:04.556176 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Roles: member,reader Oct 19 00:41:04.557715 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dfb46376a666496b896ad085315c58fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dfb46376a666496b896ad085315c58fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dfb46376a666496b896ad085315c58fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dfb46376a666496b896ad085315c58fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:41:04.557715 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant: tempest-DeleteServersTestJSON-1444479242 Oct 19 00:41:04.557715 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Id: dfb46376a666496b896ad085315c58fd Oct 19 00:41:04.557715 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Name: tempest-DeleteServersTestJSON-1444479242 Oct 19 00:41:04.557715 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User: tempest-DeleteServersTestJSON-1444479242-project Oct 19 00:41:04.557715 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Id: default Oct 19 00:41:04.557715 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Name: Default Oct 19 00:41:04.557715 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Id: dda9dd9eb8d3446c96b0c702dd09d2fa Oct 19 00:41:04.557715 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Name: tempest-DeleteServersTestJSON-1444479242-project Oct 19 00:41:04.557715 dv-cinder-master-3-smb devstack@n-api.service[125531]: method: > Oct 19 00:41:04.557715 dv-cinder-master-3-smb devstack@n-api.service[125531]: exception: Instance b669ea21-79c9-4f4c-aa6b-e6c0cec96641 could not be found. Oct 19 00:41:04.557715 dv-cinder-master-3-smb devstack@n-api.service[125531]: action_args: {'id': 'b669ea21-79c9-4f4c-aa6b-e6c0cec96641'} Oct 19 00:41:04.558599 dv-cinder-master-3-smb devstack@n-api.service[125531]: {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:41:04.558599 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:41:04.558599 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:41:04.558599 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:41:04.558599 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:41:04.558599 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:41:04.558599 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:41:04.558599 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:41:04.558599 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:41:04.558599 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:41:04.558599 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b669ea21-79c9-4f4c-aa6b-e6c0cec96641 could not be found. Oct 19 00:41:04.558599 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:41:04.558599 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:41:04.558599 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:41:04.558599 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:41:04.558599 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:41:04.558599 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:41:04.558599 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:41:04.558599 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:41:04.558599 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:41:04.560013 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:41:04.560013 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:41:04.560013 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:41:04.560013 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:41:04.560013 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:41:04.560013 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:41:04.560013 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:41:04.560013 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b669ea21-79c9-4f4c-aa6b-e6c0cec96641 could not be found. Oct 19 00:41:04.560013 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:41:04.560013 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:41:04.560013 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:41:04.560013 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:41:04.560013 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:41:04.560013 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:41:04.560013 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:41:04.560013 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:41:04.560013 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b669ea21-79c9-4f4c-aa6b-e6c0cec96641 could not be found. Oct 19 00:41:04.560013 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:41:04.561494 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-681a8a71-7c96-499e-b8a2-0c1be302bc32 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] Returning 404 to user: Instance b669ea21-79c9-4f4c-aa6b-e6c0cec96641 could not be found. {{(pid=125531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:41:04.561494 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-681a8a71-7c96-499e-b8a2-0c1be302bc32 tempest-DeleteServersTestJSON-1444479242 tempest-DeleteServersTestJSON-1444479242-project] 10.222.0.33 "GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641" status: 404 len: 111 microversion: 2.1 time: 0.030080 Oct 19 00:41:04.561494 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 119/264] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:04 2022] GET /compute/v2.1/servers/b669ea21-79c9-4f4c-aa6b-e6c0cec96641 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:41:04.687999 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-4780b54b-c9bb-4e42-800e-764d29aa1521 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:04.688622 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-4780b54b-c9bb-4e42-800e-764d29aa1521 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] [instance: 27c84340-8c49-4f3f-8c36-eb1a2cdaa804] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:04.694788 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4780b54b-c9bb-4e42-800e-764d29aa1521 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:04.695264 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4780b54b-c9bb-4e42-800e-764d29aa1521 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:04.695693 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4780b54b-c9bb-4e42-800e-764d29aa1521 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:04.696433 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4780b54b-c9bb-4e42-800e-764d29aa1521 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:04.696920 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4780b54b-c9bb-4e42-800e-764d29aa1521 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:04.697343 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4780b54b-c9bb-4e42-800e-764d29aa1521 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:04.794565 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-f6881b5c-03e7-468f-a52e-ea598e40fe41 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:04.795238 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-f6881b5c-03e7-468f-a52e-ea598e40fe41 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] [instance: da272379-872f-4ae8-b961-47c6c5a50738] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:04.801993 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f6881b5c-03e7-468f-a52e-ea598e40fe41 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:04.802601 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f6881b5c-03e7-468f-a52e-ea598e40fe41 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:04.803122 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f6881b5c-03e7-468f-a52e-ea598e40fe41 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:04.804019 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f6881b5c-03e7-468f-a52e-ea598e40fe41 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:04.804472 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f6881b5c-03e7-468f-a52e-ea598e40fe41 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:04.804895 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f6881b5c-03e7-468f-a52e-ea598e40fe41 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:04.950936 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-f6881b5c-03e7-468f-a52e-ea598e40fe41 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ed34d4b774af4821303c98872e6e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab0bf27d6c7415f9d3fc8f873a0607f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:04.959451 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-f6881b5c-03e7-468f-a52e-ea598e40fe41 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] 10.222.0.33 "GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738" status: 200 len: 1315 microversion: 2.1 time: 0.168669 Oct 19 00:41:04.960310 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 120/265] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:04 2022] GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:41:04.983018 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-4780b54b-c9bb-4e42-800e-764d29aa1521 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e5b2b9d844730bf0c955c1c47b582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78099a2acb31422095531592b7c2da20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:04.991623 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-4780b54b-c9bb-4e42-800e-764d29aa1521 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] 10.222.0.33 "GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804" status: 200 len: 1461 microversion: 2.1 time: 0.307634 Oct 19 00:41:04.992210 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 146/266] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:04 2022] GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804 => generated 1461 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:05.180397 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-90e6a1ed-b9fa-481f-909a-dfead0fa285b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:05.181071 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-90e6a1ed-b9fa-481f-909a-dfead0fa285b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:05.187650 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-90e6a1ed-b9fa-481f-909a-dfead0fa285b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:05.188157 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-90e6a1ed-b9fa-481f-909a-dfead0fa285b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:05.188603 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-90e6a1ed-b9fa-481f-909a-dfead0fa285b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:05.189291 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-90e6a1ed-b9fa-481f-909a-dfead0fa285b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:05.189745 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-90e6a1ed-b9fa-481f-909a-dfead0fa285b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:05.190169 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-90e6a1ed-b9fa-481f-909a-dfead0fa285b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:05.317486 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-90e6a1ed-b9fa-481f-909a-dfead0fa285b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:05.327200 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-90e6a1ed-b9fa-481f-909a-dfead0fa285b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1521 microversion: 2.1 time: 0.150544 Oct 19 00:41:05.327777 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 121/267] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:05 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:05.994821 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-7859ef8f-9028-43b1-b5e5-bb92c901d502 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:05.996190 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-7859ef8f-9028-43b1-b5e5-bb92c901d502 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] [instance: da272379-872f-4ae8-b961-47c6c5a50738] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:06.009057 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7859ef8f-9028-43b1-b5e5-bb92c901d502 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:06.011921 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7859ef8f-9028-43b1-b5e5-bb92c901d502 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:06.011921 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7859ef8f-9028-43b1-b5e5-bb92c901d502 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:06.011921 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7859ef8f-9028-43b1-b5e5-bb92c901d502 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:06.013514 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7859ef8f-9028-43b1-b5e5-bb92c901d502 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:06.014277 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7859ef8f-9028-43b1-b5e5-bb92c901d502 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:06.017510 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-9c92384e-fc2a-4cb8-bedf-7fefb0e78574 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:06.018140 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-9c92384e-fc2a-4cb8-bedf-7fefb0e78574 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] [instance: 27c84340-8c49-4f3f-8c36-eb1a2cdaa804] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:06.029679 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9c92384e-fc2a-4cb8-bedf-7fefb0e78574 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:06.030183 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9c92384e-fc2a-4cb8-bedf-7fefb0e78574 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:06.030627 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9c92384e-fc2a-4cb8-bedf-7fefb0e78574 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:06.031707 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9c92384e-fc2a-4cb8-bedf-7fefb0e78574 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:06.032196 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9c92384e-fc2a-4cb8-bedf-7fefb0e78574 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:06.032624 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9c92384e-fc2a-4cb8-bedf-7fefb0e78574 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:06.097259 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9c92384e-fc2a-4cb8-bedf-7fefb0e78574 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:06.098249 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9c92384e-fc2a-4cb8-bedf-7fefb0e78574 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:06.098867 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9c92384e-fc2a-4cb8-bedf-7fefb0e78574 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:06.099538 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.objects.instance [None req-9c92384e-fc2a-4cb8-bedf-7fefb0e78574 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lazy-loading 'fault' on Instance uuid 27c84340-8c49-4f3f-8c36-eb1a2cdaa804 {{(pid=125531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:41:06.149659 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-9c92384e-fc2a-4cb8-bedf-7fefb0e78574 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e5b2b9d844730bf0c955c1c47b582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78099a2acb31422095531592b7c2da20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:06.163570 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-9c92384e-fc2a-4cb8-bedf-7fefb0e78574 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] 10.222.0.33 "GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804" status: 200 len: 1303 microversion: 2.1 time: 0.150115 Oct 19 00:41:06.164953 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 122/268] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:06 2022] GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804 => generated 1303 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:41:06.324152 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-7859ef8f-9028-43b1-b5e5-bb92c901d502 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ed34d4b774af4821303c98872e6e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab0bf27d6c7415f9d3fc8f873a0607f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:06.346794 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-7859ef8f-9028-43b1-b5e5-bb92c901d502 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] 10.222.0.33 "GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738" status: 200 len: 1315 microversion: 2.1 time: 0.367515 Oct 19 00:41:06.365464 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-15b5afad-954e-4db9-9b53-4e5ea58db3fe tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:06.367402 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-15b5afad-954e-4db9-9b53-4e5ea58db3fe tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:06.372978 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 147/269] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:05 2022] GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738 => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:06.375436 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-15b5afad-954e-4db9-9b53-4e5ea58db3fe tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:06.375968 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-15b5afad-954e-4db9-9b53-4e5ea58db3fe tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:06.387813 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-15b5afad-954e-4db9-9b53-4e5ea58db3fe tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:06.389989 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-15b5afad-954e-4db9-9b53-4e5ea58db3fe tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:06.390796 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-15b5afad-954e-4db9-9b53-4e5ea58db3fe tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:06.391502 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-15b5afad-954e-4db9-9b53-4e5ea58db3fe tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:06.723340 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-15b5afad-954e-4db9-9b53-4e5ea58db3fe tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:06.736904 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-15b5afad-954e-4db9-9b53-4e5ea58db3fe tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1521 microversion: 2.1 time: 0.375397 Oct 19 00:41:06.737903 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 123/270] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:06 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1521 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:07.192254 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-41a9dde9-0624-4cb9-9c9c-3842b62228a0 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:07.193528 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-41a9dde9-0624-4cb9-9c9c-3842b62228a0 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] [instance: 27c84340-8c49-4f3f-8c36-eb1a2cdaa804] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:07.202028 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-41a9dde9-0624-4cb9-9c9c-3842b62228a0 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:07.204452 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-41a9dde9-0624-4cb9-9c9c-3842b62228a0 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:07.205088 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-41a9dde9-0624-4cb9-9c9c-3842b62228a0 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:07.206273 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-41a9dde9-0624-4cb9-9c9c-3842b62228a0 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:07.207995 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-41a9dde9-0624-4cb9-9c9c-3842b62228a0 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:07.209576 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-41a9dde9-0624-4cb9-9c9c-3842b62228a0 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:07.277446 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-41a9dde9-0624-4cb9-9c9c-3842b62228a0 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:07.277937 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-41a9dde9-0624-4cb9-9c9c-3842b62228a0 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:07.278376 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-41a9dde9-0624-4cb9-9c9c-3842b62228a0 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:07.283898 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.objects.instance [None req-41a9dde9-0624-4cb9-9c9c-3842b62228a0 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lazy-loading 'fault' on Instance uuid 27c84340-8c49-4f3f-8c36-eb1a2cdaa804 {{(pid=125532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:41:07.340764 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-41a9dde9-0624-4cb9-9c9c-3842b62228a0 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a76e5b2b9d844730bf0c955c1c47b582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78099a2acb31422095531592b7c2da20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:07.351241 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-41a9dde9-0624-4cb9-9c9c-3842b62228a0 tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] 10.222.0.33 "GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804" status: 200 len: 1303 microversion: 2.1 time: 0.162944 Oct 19 00:41:07.353024 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 148/271] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:07 2022] GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804 => generated 1303 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:07.370328 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-12090216-96fd-4c06-8c4b-836a3c511b84 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:07.371802 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-12090216-96fd-4c06-8c4b-836a3c511b84 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] [instance: da272379-872f-4ae8-b961-47c6c5a50738] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:07.379646 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-12090216-96fd-4c06-8c4b-836a3c511b84 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:07.380451 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-12090216-96fd-4c06-8c4b-836a3c511b84 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:07.381040 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-12090216-96fd-4c06-8c4b-836a3c511b84 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:07.381903 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-12090216-96fd-4c06-8c4b-836a3c511b84 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:07.382535 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-12090216-96fd-4c06-8c4b-836a3c511b84 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:07.383103 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-12090216-96fd-4c06-8c4b-836a3c511b84 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:07.613884 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-12090216-96fd-4c06-8c4b-836a3c511b84 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ed34d4b774af4821303c98872e6e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab0bf27d6c7415f9d3fc8f873a0607f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:07.622913 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-12090216-96fd-4c06-8c4b-836a3c511b84 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] 10.222.0.33 "GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738" status: 200 len: 1464 microversion: 2.1 time: 0.256406 Oct 19 00:41:07.623542 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 124/272] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:07 2022] GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738 => generated 1464 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:07.675636 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-99b1d798-def4-4dbc-9950-79571a5693fc tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:07.676799 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-99b1d798-def4-4dbc-9950-79571a5693fc tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] [instance: da272379-872f-4ae8-b961-47c6c5a50738] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:07.682747 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-99b1d798-def4-4dbc-9950-79571a5693fc tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:07.683227 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-99b1d798-def4-4dbc-9950-79571a5693fc tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:07.683723 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-99b1d798-def4-4dbc-9950-79571a5693fc tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:07.684466 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-99b1d798-def4-4dbc-9950-79571a5693fc tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:07.684918 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-99b1d798-def4-4dbc-9950-79571a5693fc tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:07.685339 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-99b1d798-def4-4dbc-9950-79571a5693fc tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:07.712391 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-99b1d798-def4-4dbc-9950-79571a5693fc tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] [instance: da272379-872f-4ae8-b961-47c6c5a50738] Going to try to terminate instance {{(pid=125532) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:41:07.769494 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-6f76140b-b1c9-4c3b-9110-198a0737e66e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:07.770685 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-6f76140b-b1c9-4c3b-9110-198a0737e66e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:07.779233 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6f76140b-b1c9-4c3b-9110-198a0737e66e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:07.779747 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6f76140b-b1c9-4c3b-9110-198a0737e66e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:07.780740 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6f76140b-b1c9-4c3b-9110-198a0737e66e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:07.781458 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6f76140b-b1c9-4c3b-9110-198a0737e66e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:07.781909 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6f76140b-b1c9-4c3b-9110-198a0737e66e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:07.782334 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6f76140b-b1c9-4c3b-9110-198a0737e66e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:07.804876 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-99b1d798-def4-4dbc-9950-79571a5693fc tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] 10.222.0.33 "DELETE /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738" status: 204 len: 0 microversion: 2.1 time: 0.132935 Oct 19 00:41:07.805512 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 149/273] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Oct 19 00:41:07 2022] DELETE /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:41:07.816633 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-b58352f4-a723-48f3-8a18-54c282d36eac tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:07.817354 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-b58352f4-a723-48f3-8a18-54c282d36eac tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] [instance: da272379-872f-4ae8-b961-47c6c5a50738] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:07.826506 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b58352f4-a723-48f3-8a18-54c282d36eac tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:07.827698 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b58352f4-a723-48f3-8a18-54c282d36eac tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:07.828309 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b58352f4-a723-48f3-8a18-54c282d36eac tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:07.829051 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b58352f4-a723-48f3-8a18-54c282d36eac tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:07.829717 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b58352f4-a723-48f3-8a18-54c282d36eac tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:07.830697 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b58352f4-a723-48f3-8a18-54c282d36eac tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:07.981599 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-b58352f4-a723-48f3-8a18-54c282d36eac tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ed34d4b774af4821303c98872e6e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab0bf27d6c7415f9d3fc8f873a0607f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:07.989342 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-b58352f4-a723-48f3-8a18-54c282d36eac tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] 10.222.0.33 "GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738" status: 200 len: 1470 microversion: 2.1 time: 0.179334 Oct 19 00:41:07.989913 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 150/274] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:07 2022] GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738 => generated 1470 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:41:08.040795 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-6f76140b-b1c9-4c3b-9110-198a0737e66e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:08.049763 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-6f76140b-b1c9-4c3b-9110-198a0737e66e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1521 microversion: 2.1 time: 0.286099 Oct 19 00:41:08.050527 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 125/275] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:07 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:08.376857 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-3be94604-34d2-4976-b112-606da5bfd02c tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:08.377633 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-3be94604-34d2-4976-b112-606da5bfd02c tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] [instance: 27c84340-8c49-4f3f-8c36-eb1a2cdaa804] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:08.383889 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3be94604-34d2-4976-b112-606da5bfd02c tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:08.384557 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3be94604-34d2-4976-b112-606da5bfd02c tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:08.384984 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3be94604-34d2-4976-b112-606da5bfd02c tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:08.385679 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3be94604-34d2-4976-b112-606da5bfd02c tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:08.386133 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3be94604-34d2-4976-b112-606da5bfd02c tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:08.386562 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3be94604-34d2-4976-b112-606da5bfd02c tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:08.400393 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.wsgi [None req-3be94604-34d2-4976-b112-606da5bfd02c tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] HTTP exception thrown: Instance 27c84340-8c49-4f3f-8c36-eb1a2cdaa804 could not be found. Oct 19 00:41:08.402017 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-3be94604-34d2-4976-b112-606da5bfd02c tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Request method failure captured: Oct 19 00:41:08.402017 dv-cinder-master-3-smb devstack@n-api.service[125532]: request: GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804 HTTP/1.1 Oct 19 00:41:08.402017 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept: application/json Oct 19 00:41:08.402017 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept-Encoding: identity Oct 19 00:41:08.402017 dv-cinder-master-3-smb devstack@n-api.service[125532]: Connection: close Oct 19 00:41:08.402017 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Length: 0 Oct 19 00:41:08.402017 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Type: application/json Oct 19 00:41:08.402017 dv-cinder-master-3-smb devstack@n-api.service[125532]: Host: 10.222.0.33 Oct 19 00:41:08.402017 dv-cinder-master-3-smb devstack@n-api.service[125532]: Openstack-System-Scope: None Oct 19 00:41:08.402017 dv-cinder-master-3-smb devstack@n-api.service[125532]: User-Agent: python-urllib3/1.26.12 Oct 19 00:41:08.402017 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Auth-Token: gAAAAABjT0d1WPhrfijoaD7k1jhHYh3IVrJsoGU7cuOeTp85VEH-gzqiuDC-6RAD5WEMV4ETGz3PyX4GRZgcLFo2tZ0T1s48CI6hLe6FrkSHzepo_qLu1zAq6-N2MHxqvxU_E-WGrmStrW4Bhslto8ZUKdgoFAbIG2BOvAPtJQ1igkY_3yO6EJI Oct 19 00:41:08.402017 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Id: None Oct 19 00:41:08.402017 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Name: None Oct 19 00:41:08.402017 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Identity-Status: Confirmed Oct 19 00:41:08.402017 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Is-Admin-Project: True Oct 19 00:41:08.402017 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Id: default Oct 19 00:41:08.402017 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Name: Default Oct 19 00:41:08.402017 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Id: 78099a2acb31422095531592b7c2da20 Oct 19 00:41:08.402017 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Name: tempest-VolumesActionsTest-1226417612 Oct 19 00:41:08.402017 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Role: member,reader Oct 19 00:41:08.402017 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Roles: member,reader Oct 19 00:41:08.403458 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78099a2acb31422095531592b7c2da20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78099a2acb31422095531592b7c2da20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78099a2acb31422095531592b7c2da20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78099a2acb31422095531592b7c2da20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:41:08.403458 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant: tempest-VolumesActionsTest-1226417612 Oct 19 00:41:08.403458 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Id: 78099a2acb31422095531592b7c2da20 Oct 19 00:41:08.403458 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Name: tempest-VolumesActionsTest-1226417612 Oct 19 00:41:08.403458 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User: tempest-VolumesActionsTest-1226417612-project Oct 19 00:41:08.403458 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Id: default Oct 19 00:41:08.403458 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Name: Default Oct 19 00:41:08.403458 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Id: a76e5b2b9d844730bf0c955c1c47b582 Oct 19 00:41:08.403458 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Name: tempest-VolumesActionsTest-1226417612-project Oct 19 00:41:08.403458 dv-cinder-master-3-smb devstack@n-api.service[125532]: method: > Oct 19 00:41:08.403458 dv-cinder-master-3-smb devstack@n-api.service[125532]: exception: Instance 27c84340-8c49-4f3f-8c36-eb1a2cdaa804 could not be found. Oct 19 00:41:08.403458 dv-cinder-master-3-smb devstack@n-api.service[125532]: action_args: {'id': '27c84340-8c49-4f3f-8c36-eb1a2cdaa804'} Oct 19 00:41:08.404421 dv-cinder-master-3-smb devstack@n-api.service[125532]: {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:41:08.404421 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:41:08.404421 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:41:08.404421 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:41:08.404421 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:41:08.404421 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:41:08.404421 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:41:08.404421 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:41:08.404421 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:41:08.404421 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:41:08.404421 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27c84340-8c49-4f3f-8c36-eb1a2cdaa804 could not be found. Oct 19 00:41:08.404421 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:08.404421 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:41:08.404421 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:08.404421 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:41:08.404421 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:41:08.404421 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:41:08.404421 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:41:08.404421 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:41:08.404421 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:41:08.406092 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:41:08.406092 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:41:08.406092 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:41:08.406092 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:41:08.406092 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:41:08.406092 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:41:08.406092 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:41:08.406092 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27c84340-8c49-4f3f-8c36-eb1a2cdaa804 could not be found. Oct 19 00:41:08.406092 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:08.406092 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:41:08.406092 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:08.406092 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:41:08.406092 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:41:08.406092 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:41:08.406092 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:41:08.406092 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:41:08.406092 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27c84340-8c49-4f3f-8c36-eb1a2cdaa804 could not be found. Oct 19 00:41:08.406092 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:08.408481 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-3be94604-34d2-4976-b112-606da5bfd02c tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] Returning 404 to user: Instance 27c84340-8c49-4f3f-8c36-eb1a2cdaa804 could not be found. {{(pid=125532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:41:08.409414 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-3be94604-34d2-4976-b112-606da5bfd02c tempest-VolumesActionsTest-1226417612 tempest-VolumesActionsTest-1226417612-project] 10.222.0.33 "GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804" status: 404 len: 111 microversion: 2.1 time: 0.037079 Oct 19 00:41:08.413725 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 151/276] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:08 2022] GET /compute/v2.1/servers/27c84340-8c49-4f3f-8c36-eb1a2cdaa804 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:41:09.012584 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-e029910c-aa37-4161-bb0e-7c305e2564a9 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:09.013201 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-e029910c-aa37-4161-bb0e-7c305e2564a9 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] [instance: da272379-872f-4ae8-b961-47c6c5a50738] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:09.020161 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e029910c-aa37-4161-bb0e-7c305e2564a9 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:09.020661 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e029910c-aa37-4161-bb0e-7c305e2564a9 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:09.021080 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e029910c-aa37-4161-bb0e-7c305e2564a9 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:09.021774 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e029910c-aa37-4161-bb0e-7c305e2564a9 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:09.022229 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e029910c-aa37-4161-bb0e-7c305e2564a9 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:09.022655 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e029910c-aa37-4161-bb0e-7c305e2564a9 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:09.073870 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-f3db0ec8-b49b-4af2-9430-4c4dce95dcc6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:09.074417 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-f3db0ec8-b49b-4af2-9430-4c4dce95dcc6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:09.081151 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f3db0ec8-b49b-4af2-9430-4c4dce95dcc6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:09.081626 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f3db0ec8-b49b-4af2-9430-4c4dce95dcc6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:09.082059 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f3db0ec8-b49b-4af2-9430-4c4dce95dcc6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:09.082747 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f3db0ec8-b49b-4af2-9430-4c4dce95dcc6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:09.083196 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f3db0ec8-b49b-4af2-9430-4c4dce95dcc6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:09.083619 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f3db0ec8-b49b-4af2-9430-4c4dce95dcc6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:09.175391 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-e029910c-aa37-4161-bb0e-7c305e2564a9 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ed34d4b774af4821303c98872e6e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab0bf27d6c7415f9d3fc8f873a0607f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:09.184613 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-e029910c-aa37-4161-bb0e-7c305e2564a9 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] 10.222.0.33 "GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738" status: 200 len: 1470 microversion: 2.1 time: 0.175858 Oct 19 00:41:09.185395 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 126/277] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:09 2022] GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738 => generated 1470 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:09.238176 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-f3db0ec8-b49b-4af2-9430-4c4dce95dcc6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:09.245969 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-f3db0ec8-b49b-4af2-9430-4c4dce95dcc6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1521 microversion: 2.1 time: 0.175938 Oct 19 00:41:09.246765 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 152/278] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:09 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:41:09.938121 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-0d005c47-510c-4b98-afbf-af5c5f0b836c tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] Action: 'create', calling method: .version_select at 0x7f81f1294280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-849254069"}} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:41:10.212026 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-0ffbf85c-9eaa-4b4d-b1c8-e727e3e92995 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:10.213425 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-0ffbf85c-9eaa-4b4d-b1c8-e727e3e92995 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] [instance: da272379-872f-4ae8-b961-47c6c5a50738] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:10.223462 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0ffbf85c-9eaa-4b4d-b1c8-e727e3e92995 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:10.224508 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0ffbf85c-9eaa-4b4d-b1c8-e727e3e92995 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:10.225242 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0ffbf85c-9eaa-4b4d-b1c8-e727e3e92995 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:10.226505 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0ffbf85c-9eaa-4b4d-b1c8-e727e3e92995 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:10.227371 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0ffbf85c-9eaa-4b4d-b1c8-e727e3e92995 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:10.228045 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0ffbf85c-9eaa-4b4d-b1c8-e727e3e92995 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:10.291671 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-0d005c47-510c-4b98-afbf-af5c5f0b836c tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.471483 Oct 19 00:41:10.292408 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 127/279] 10.222.0.33 () {60 vars in 1155 bytes} [Wed Oct 19 00:41:09 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 473 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 19 00:41:10.297533 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-4278f290-d4f0-4342-88ef-ebea9873910a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:10.298359 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-4278f290-d4f0-4342-88ef-ebea9873910a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:10.312956 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4278f290-d4f0-4342-88ef-ebea9873910a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:10.315715 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4278f290-d4f0-4342-88ef-ebea9873910a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:10.316377 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4278f290-d4f0-4342-88ef-ebea9873910a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:10.317261 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4278f290-d4f0-4342-88ef-ebea9873910a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:10.317872 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4278f290-d4f0-4342-88ef-ebea9873910a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:10.318495 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4278f290-d4f0-4342-88ef-ebea9873910a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:10.393459 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-0ffbf85c-9eaa-4b4d-b1c8-e727e3e92995 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ed34d4b774af4821303c98872e6e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab0bf27d6c7415f9d3fc8f873a0607f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:10.402514 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-0ffbf85c-9eaa-4b4d-b1c8-e727e3e92995 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] 10.222.0.33 "GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738" status: 200 len: 1470 microversion: 2.1 time: 0.195771 Oct 19 00:41:10.403082 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 153/280] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:10 2022] GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738 => generated 1470 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:10.408390 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-9078377f-3341-49cc-930b-7fd236342c63 tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] Calling method '.version_select at 0x7f81f1109f70>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:10.461211 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-9078377f-3341-49cc-930b-7fd236342c63 tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/0ac25344-499a-4161-b676-33f336769728" status: 200 len: 344 microversion: 2.1 time: 0.057040 Oct 19 00:41:10.461754 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 154/281] 10.222.0.33 () {58 vars in 1245 bytes} [Wed Oct 19 00:41:10 2022] GET /compute/v2.1/os-volumes/0ac25344-499a-4161-b676-33f336769728 => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:41:10.550187 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-f2404f66-7cde-40ea-8fcf-885f276e616a req-0ad6fe21-1c96-45a6-84ed-7f2d807d03a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da272379-872f-4ae8-b961-47c6c5a50738", "name": "network-vif-deleted", "tag": "5918f28b-5dd0-4997-a671-7857d13d7fd3"}]} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:41:10.560838 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-f2404f66-7cde-40ea-8fcf-885f276e616a req-0ad6fe21-1c96-45a6-84ed-7f2d807d03a8 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:10.561456 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-f2404f66-7cde-40ea-8fcf-885f276e616a req-0ad6fe21-1c96-45a6-84ed-7f2d807d03a8 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:10.562351 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-f2404f66-7cde-40ea-8fcf-885f276e616a req-0ad6fe21-1c96-45a6-84ed-7f2d807d03a8 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:10.574348 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.compute.server_external_events [req-f2404f66-7cde-40ea-8fcf-885f276e616a req-0ad6fe21-1c96-45a6-84ed-7f2d807d03a8 service nova] Creating event network-vif-deleted:5918f28b-5dd0-4997-a671-7857d13d7fd3 for instance da272379-872f-4ae8-b961-47c6c5a50738 on hv-cinder-maste Oct 19 00:41:10.580043 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-f2404f66-7cde-40ea-8fcf-885f276e616a req-0ad6fe21-1c96-45a6-84ed-7f2d807d03a8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033628 Oct 19 00:41:10.581231 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 155/282] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:41:10.581843 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-4278f290-d4f0-4342-88ef-ebea9873910a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:10.593108 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-4278f290-d4f0-4342-88ef-ebea9873910a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1521 microversion: 2.1 time: 0.299082 Oct 19 00:41:10.593958 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 128/283] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:10 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:11.427544 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-2e775841-00b5-45f9-a2f6-18fd54df4017 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:11.428212 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-2e775841-00b5-45f9-a2f6-18fd54df4017 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] [instance: da272379-872f-4ae8-b961-47c6c5a50738] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:11.434351 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2e775841-00b5-45f9-a2f6-18fd54df4017 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:11.434836 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2e775841-00b5-45f9-a2f6-18fd54df4017 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:11.435271 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2e775841-00b5-45f9-a2f6-18fd54df4017 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:11.436054 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2e775841-00b5-45f9-a2f6-18fd54df4017 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:11.437391 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2e775841-00b5-45f9-a2f6-18fd54df4017 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:11.437815 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2e775841-00b5-45f9-a2f6-18fd54df4017 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:11.450723 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.wsgi [None req-2e775841-00b5-45f9-a2f6-18fd54df4017 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] HTTP exception thrown: Instance da272379-872f-4ae8-b961-47c6c5a50738 could not be found. Oct 19 00:41:11.452428 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-2e775841-00b5-45f9-a2f6-18fd54df4017 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Request method failure captured: Oct 19 00:41:11.452428 dv-cinder-master-3-smb devstack@n-api.service[125532]: request: GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738 HTTP/1.1 Oct 19 00:41:11.452428 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept: application/json Oct 19 00:41:11.452428 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept-Encoding: identity Oct 19 00:41:11.452428 dv-cinder-master-3-smb devstack@n-api.service[125532]: Connection: close Oct 19 00:41:11.452428 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Length: 0 Oct 19 00:41:11.452428 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Type: application/json Oct 19 00:41:11.452428 dv-cinder-master-3-smb devstack@n-api.service[125532]: Host: 10.222.0.33 Oct 19 00:41:11.452428 dv-cinder-master-3-smb devstack@n-api.service[125532]: Openstack-System-Scope: None Oct 19 00:41:11.452428 dv-cinder-master-3-smb devstack@n-api.service[125532]: User-Agent: python-urllib3/1.26.12 Oct 19 00:41:11.452428 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Auth-Token: gAAAAABjT0eAyu1V-5HNjFK47WsI214rj1CRI0SFuKoA1lP0AFo5zv8Kftf3hjAao_DP3wg-Rq7K-fK3ojsgfbw6vmHkTViz5pzf_c3YQYX3-UA0NHSpzqo40RlBl5RvrwtZaYM_n7xGlbz36rQAgEoQ9r63xMGPuOZO1Af4hhjKh7-C8PXBSYg Oct 19 00:41:11.452428 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Id: None Oct 19 00:41:11.452428 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Name: None Oct 19 00:41:11.452428 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Identity-Status: Confirmed Oct 19 00:41:11.452428 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Is-Admin-Project: True Oct 19 00:41:11.452428 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Id: default Oct 19 00:41:11.452428 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Name: Default Oct 19 00:41:11.452428 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Id: aab0bf27d6c7415f9d3fc8f873a0607f Oct 19 00:41:11.452428 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Name: tempest-VolumesNegativeTest-1139483901 Oct 19 00:41:11.452428 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Role: member,reader Oct 19 00:41:11.452428 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Roles: member,reader Oct 19 00:41:11.453883 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_aab0bf27d6c7415f9d3fc8f873a0607f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aab0bf27d6c7415f9d3fc8f873a0607f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/aab0bf27d6c7415f9d3fc8f873a0607f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aab0bf27d6c7415f9d3fc8f873a0607f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:41:11.453883 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant: tempest-VolumesNegativeTest-1139483901 Oct 19 00:41:11.453883 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Id: aab0bf27d6c7415f9d3fc8f873a0607f Oct 19 00:41:11.453883 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Name: tempest-VolumesNegativeTest-1139483901 Oct 19 00:41:11.453883 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User: tempest-VolumesNegativeTest-1139483901-project Oct 19 00:41:11.453883 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Id: default Oct 19 00:41:11.453883 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Name: Default Oct 19 00:41:11.453883 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Id: 0f8ed34d4b774af4821303c98872e6e7 Oct 19 00:41:11.453883 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Name: tempest-VolumesNegativeTest-1139483901-project Oct 19 00:41:11.453883 dv-cinder-master-3-smb devstack@n-api.service[125532]: method: > Oct 19 00:41:11.453883 dv-cinder-master-3-smb devstack@n-api.service[125532]: exception: Instance da272379-872f-4ae8-b961-47c6c5a50738 could not be found. Oct 19 00:41:11.453883 dv-cinder-master-3-smb devstack@n-api.service[125532]: action_args: {'id': 'da272379-872f-4ae8-b961-47c6c5a50738'} Oct 19 00:41:11.454714 dv-cinder-master-3-smb devstack@n-api.service[125532]: {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:41:11.454714 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:41:11.454714 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:41:11.454714 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:41:11.454714 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:41:11.454714 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:41:11.454714 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:41:11.454714 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:41:11.454714 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:41:11.454714 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:41:11.454714 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da272379-872f-4ae8-b961-47c6c5a50738 could not be found. Oct 19 00:41:11.454714 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:11.454714 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:41:11.454714 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:11.454714 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:41:11.454714 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:41:11.454714 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:41:11.454714 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:41:11.454714 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:41:11.454714 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:41:11.456056 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:41:11.456056 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:41:11.456056 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:41:11.456056 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:41:11.456056 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:41:11.456056 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:41:11.456056 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:41:11.456056 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da272379-872f-4ae8-b961-47c6c5a50738 could not be found. Oct 19 00:41:11.456056 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:11.456056 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:41:11.456056 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:11.456056 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:41:11.456056 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:41:11.456056 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:41:11.456056 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:41:11.456056 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:41:11.456056 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da272379-872f-4ae8-b961-47c6c5a50738 could not be found. Oct 19 00:41:11.456056 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:11.457247 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-2e775841-00b5-45f9-a2f6-18fd54df4017 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] Returning 404 to user: Instance da272379-872f-4ae8-b961-47c6c5a50738 could not be found. {{(pid=125532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:41:11.457247 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-2e775841-00b5-45f9-a2f6-18fd54df4017 tempest-VolumesNegativeTest-1139483901 tempest-VolumesNegativeTest-1139483901-project] 10.222.0.33 "GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738" status: 404 len: 111 microversion: 2.1 time: 0.030717 Oct 19 00:41:11.457247 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 156/284] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:11 2022] GET /compute/v2.1/servers/da272379-872f-4ae8-b961-47c6c5a50738 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:41:11.476461 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-39dbd753-55cc-4a89-adb1-f0624091723b tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] Calling method '.version_select at 0x7f81f11405e0>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:11.527032 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-39dbd753-55cc-4a89-adb1-f0624091723b tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/0ac25344-499a-4161-b676-33f336769728" status: 200 len: 345 microversion: 2.1 time: 0.054876 Oct 19 00:41:11.527733 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 129/285] 10.222.0.33 () {58 vars in 1245 bytes} [Wed Oct 19 00:41:11 2022] GET /compute/v2.1/os-volumes/0ac25344-499a-4161-b676-33f336769728 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:41:11.541131 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-79cfd4f7-508c-49df-8696-e590778fcd1f tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] Action: 'create', calling method: .version_select at 0x7f81f1109ca0>, body: {"snapshot": {"volume_id": "0ac25344-499a-4161-b676-33f336769728", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1006432468"}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:41:11.619997 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-d9445b0e-1e69-4d4d-acc1-edc2acafd98e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:11.621193 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-d9445b0e-1e69-4d4d-acc1-edc2acafd98e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:11.630128 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d9445b0e-1e69-4d4d-acc1-edc2acafd98e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:11.630804 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d9445b0e-1e69-4d4d-acc1-edc2acafd98e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:11.631246 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d9445b0e-1e69-4d4d-acc1-edc2acafd98e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:11.632066 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d9445b0e-1e69-4d4d-acc1-edc2acafd98e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:11.632523 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d9445b0e-1e69-4d4d-acc1-edc2acafd98e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:11.633111 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d9445b0e-1e69-4d4d-acc1-edc2acafd98e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:11.722145 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-79cfd4f7-508c-49df-8696-e590778fcd1f tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] 10.222.0.33 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.184640 Oct 19 00:41:11.722327 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 157/286] 10.222.0.33 () {60 vars in 1162 bytes} [Wed Oct 19 00:41:11 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:41:11.734360 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-1d67479c-6f05-4561-b3d2-8845543928b8 tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] Calling method '.version_select at 0x7f81f1219e50>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:11.774716 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-1d67479c-6f05-4561-b3d2-8845543928b8 tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/077acfd1-50bc-4d58-bf64-77ee1bf1ad12" status: 200 len: 287 microversion: 2.1 time: 0.045331 Oct 19 00:41:11.775294 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 158/287] 10.222.0.33 () {58 vars in 1251 bytes} [Wed Oct 19 00:41:11 2022] GET /compute/v2.1/os-snapshots/077acfd1-50bc-4d58-bf64-77ee1bf1ad12 => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:41:11.787690 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-594b968a-7265-43bd-86bb-17b1f64e5798 tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] Calling method '.version_select at 0x7f81f11148b0>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:11.822817 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-594b968a-7265-43bd-86bb-17b1f64e5798 tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.039844 Oct 19 00:41:11.823416 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 159/288] 10.222.0.33 () {58 vars in 1140 bytes} [Wed Oct 19 00:41:11 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:41:11.824470 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-d9445b0e-1e69-4d4d-acc1-edc2acafd98e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:11.832562 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-d9445b0e-1e69-4d4d-acc1-edc2acafd98e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1521 microversion: 2.1 time: 0.220108 Oct 19 00:41:11.834250 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-f6f72d98-92d1-4c70-8d5d-fb2bfc9e1ef6 tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] Calling method '.version_select at 0x7f81f1122670>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:11.837463 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 130/289] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:11 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:11.868165 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-f6f72d98-92d1-4c70-8d5d-fb2bfc9e1ef6 tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/077acfd1-50bc-4d58-bf64-77ee1bf1ad12" status: 200 len: 287 microversion: 2.1 time: 0.037425 Oct 19 00:41:11.868726 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 160/290] 10.222.0.33 () {58 vars in 1251 bytes} [Wed Oct 19 00:41:11 2022] GET /compute/v2.1/os-snapshots/077acfd1-50bc-4d58-bf64-77ee1bf1ad12 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:41:12.854249 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-e0eae3b6-514b-4bec-ac9c-9a90af88746f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:12.854895 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-e0eae3b6-514b-4bec-ac9c-9a90af88746f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:12.862019 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e0eae3b6-514b-4bec-ac9c-9a90af88746f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:12.862506 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e0eae3b6-514b-4bec-ac9c-9a90af88746f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:12.862942 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e0eae3b6-514b-4bec-ac9c-9a90af88746f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:12.863632 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e0eae3b6-514b-4bec-ac9c-9a90af88746f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:12.864112 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e0eae3b6-514b-4bec-ac9c-9a90af88746f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:12.864543 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e0eae3b6-514b-4bec-ac9c-9a90af88746f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:12.884767 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-498fc762-3f07-4ecf-9b05-be982e6c3240 tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] Calling method '.version_select at 0x7f81f1114160>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:12.918803 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-498fc762-3f07-4ecf-9b05-be982e6c3240 tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/077acfd1-50bc-4d58-bf64-77ee1bf1ad12" status: 200 len: 288 microversion: 2.1 time: 0.039910 Oct 19 00:41:12.919367 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 161/291] 10.222.0.33 () {58 vars in 1251 bytes} [Wed Oct 19 00:41:12 2022] GET /compute/v2.1/os-snapshots/077acfd1-50bc-4d58-bf64-77ee1bf1ad12 => generated 288 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:41:12.931037 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-282359fb-dae1-4b52-b8fa-df50b5e33aef tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] Calling method '.version_select at 0x7f81f1109430>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:13.003990 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-282359fb-dae1-4b52-b8fa-df50b5e33aef tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] 10.222.0.33 "DELETE /compute/v2.1/os-snapshots/077acfd1-50bc-4d58-bf64-77ee1bf1ad12" status: 202 len: 0 microversion: 2.1 time: 0.076719 Oct 19 00:41:13.004551 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 162/292] 10.222.0.33 () {58 vars in 1254 bytes} [Wed Oct 19 00:41:12 2022] DELETE /compute/v2.1/os-snapshots/077acfd1-50bc-4d58-bf64-77ee1bf1ad12 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 00:41:13.016581 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-c670d1be-4220-4e38-b9cf-995bb2372a00 tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] Calling method '.version_select at 0x7f81f11093a0>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:13.024618 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-e0eae3b6-514b-4bec-ac9c-9a90af88746f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:13.034464 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-e0eae3b6-514b-4bec-ac9c-9a90af88746f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1521 microversion: 2.1 time: 0.183921 Oct 19 00:41:13.035055 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 131/293] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:12 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:13.055158 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-c670d1be-4220-4e38-b9cf-995bb2372a00 tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/077acfd1-50bc-4d58-bf64-77ee1bf1ad12" status: 200 len: 287 microversion: 2.1 time: 0.044678 Oct 19 00:41:13.055723 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 163/294] 10.222.0.33 () {58 vars in 1251 bytes} [Wed Oct 19 00:41:13 2022] GET /compute/v2.1/os-snapshots/077acfd1-50bc-4d58-bf64-77ee1bf1ad12 => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:41:14.056753 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-edc15b59-4e44-4691-8bd5-31bade8c825a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:14.057507 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-edc15b59-4e44-4691-8bd5-31bade8c825a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:14.064587 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-edc15b59-4e44-4691-8bd5-31bade8c825a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:14.065316 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-edc15b59-4e44-4691-8bd5-31bade8c825a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:14.065955 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-edc15b59-4e44-4691-8bd5-31bade8c825a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:14.066841 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-edc15b59-4e44-4691-8bd5-31bade8c825a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:14.067479 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-fe86217f-e4db-447a-a095-dfcd7206ed1f tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] Calling method '.version_select at 0x7f81f1109ee0>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:14.068022 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-edc15b59-4e44-4691-8bd5-31bade8c825a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:14.068669 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-edc15b59-4e44-4691-8bd5-31bade8c825a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:14.093991 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.wsgi [None req-fe86217f-e4db-447a-a095-dfcd7206ed1f tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] HTTP exception thrown: Snapshot 077acfd1-50bc-4d58-bf64-77ee1bf1ad12 could not be found. Oct 19 00:41:14.096167 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-fe86217f-e4db-447a-a095-dfcd7206ed1f tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] Request method failure captured: Oct 19 00:41:14.096167 dv-cinder-master-3-smb devstack@n-api.service[125532]: request: GET /compute/v2.1/os-snapshots/077acfd1-50bc-4d58-bf64-77ee1bf1ad12 HTTP/1.1 Oct 19 00:41:14.096167 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept: application/json Oct 19 00:41:14.096167 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept-Encoding: identity Oct 19 00:41:14.096167 dv-cinder-master-3-smb devstack@n-api.service[125532]: Connection: close Oct 19 00:41:14.096167 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Length: 0 Oct 19 00:41:14.096167 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Type: application/json Oct 19 00:41:14.096167 dv-cinder-master-3-smb devstack@n-api.service[125532]: Host: 10.222.0.33 Oct 19 00:41:14.096167 dv-cinder-master-3-smb devstack@n-api.service[125532]: Openstack-System-Scope: None Oct 19 00:41:14.096167 dv-cinder-master-3-smb devstack@n-api.service[125532]: User-Agent: python-urllib3/1.26.12 Oct 19 00:41:14.096167 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Auth-Token: gAAAAABjT0elfz0PTUn5Ecx5BWjHLQzgmDJ4iCwKJHW2X4Z0wFxBR34cE0qdFGwueEKsV2W_gPk4wPnuSFYBLy49APGTwNFpuDRUnY_-MltgUE6WTAmiY7BeEHLZXAU4XmYgMewSIj57m1gXG4FAcQ2FK5X5bbbcarRDhvMp_OfvCDXvzzFu_-g Oct 19 00:41:14.096167 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Id: None Oct 19 00:41:14.096167 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Name: None Oct 19 00:41:14.096167 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Identity-Status: Confirmed Oct 19 00:41:14.096167 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Is-Admin-Project: True Oct 19 00:41:14.096167 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Id: default Oct 19 00:41:14.096167 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Name: Default Oct 19 00:41:14.096167 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Id: 4cb68a88f174402d8ad45065830a7d16 Oct 19 00:41:14.096167 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-524912536 Oct 19 00:41:14.096167 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Role: member,reader Oct 19 00:41:14.096167 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Roles: member,reader Oct 19 00:41:14.097694 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4cb68a88f174402d8ad45065830a7d16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4cb68a88f174402d8ad45065830a7d16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4cb68a88f174402d8ad45065830a7d16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4cb68a88f174402d8ad45065830a7d16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:41:14.097694 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant: tempest-VolumesSnapshotsTestJSON-524912536 Oct 19 00:41:14.097694 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Id: 4cb68a88f174402d8ad45065830a7d16 Oct 19 00:41:14.097694 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-524912536 Oct 19 00:41:14.097694 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User: tempest-VolumesSnapshotsTestJSON-524912536-project Oct 19 00:41:14.097694 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Id: default Oct 19 00:41:14.097694 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Name: Default Oct 19 00:41:14.097694 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Id: 60e5ac0e700d47a2a75eeaccc35b655c Oct 19 00:41:14.097694 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Name: tempest-VolumesSnapshotsTestJSON-524912536-project Oct 19 00:41:14.097694 dv-cinder-master-3-smb devstack@n-api.service[125532]: method: Oct 19 00:41:14.097694 dv-cinder-master-3-smb devstack@n-api.service[125532]: exception: Snapshot 077acfd1-50bc-4d58-bf64-77ee1bf1ad12 could not be found. Oct 19 00:41:14.097694 dv-cinder-master-3-smb devstack@n-api.service[125532]: action_args: {'id': '077acfd1-50bc-4d58-bf64-77ee1bf1ad12'} Oct 19 00:41:14.097694 dv-cinder-master-3-smb devstack@n-api.service[125532]: {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:41:14.098608 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:41:14.098608 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 19 00:41:14.098608 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 19 00:41:14.098608 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 19 00:41:14.098608 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 19 00:41:14.098608 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 19 00:41:14.098608 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 19 00:41:14.098608 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 00:41:14.098608 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 00:41:14.098608 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 00:41:14.098608 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 00:41:14.098608 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 00:41:14.098608 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 00:41:14.098608 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 00:41:14.098608 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 00:41:14.098608 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 077acfd1-50bc-4d58-bf64-77ee1bf1ad12 could not be found. (HTTP 404) (Request-ID: req-6f070bd4-44c0-4021-a612-42f9745f5781) Oct 19 00:41:14.098608 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:14.098608 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:41:14.099711 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:14.099711 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:41:14.099711 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 19 00:41:14.099711 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 19 00:41:14.099711 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 00:41:14.099711 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 00:41:14.099711 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 19 00:41:14.099711 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 19 00:41:14.099711 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 00:41:14.099711 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 00:41:14.099711 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 19 00:41:14.099711 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 19 00:41:14.099711 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 19 00:41:14.099711 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 19 00:41:14.099711 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 19 00:41:14.099711 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 19 00:41:14.099711 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 00:41:14.099711 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 00:41:14.099711 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 00:41:14.100766 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 00:41:14.100766 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 00:41:14.100766 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 00:41:14.100766 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 00:41:14.100766 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 00:41:14.100766 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 077acfd1-50bc-4d58-bf64-77ee1bf1ad12 could not be found. Oct 19 00:41:14.100766 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:14.100766 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:41:14.100766 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:14.100766 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:41:14.100766 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:41:14.100766 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:41:14.100766 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:41:14.100766 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:41:14.100766 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:41:14.100766 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:41:14.100766 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:41:14.100766 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:41:14.100766 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 19 00:41:14.100766 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:41:14.102090 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 077acfd1-50bc-4d58-bf64-77ee1bf1ad12 could not be found. Oct 19 00:41:14.102090 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:14.102090 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:41:14.102090 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:14.102090 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:41:14.102090 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:41:14.102090 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:41:14.102090 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:41:14.102090 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:41:14.102090 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 077acfd1-50bc-4d58-bf64-77ee1bf1ad12 could not be found. Oct 19 00:41:14.102090 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:14.102090 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-fe86217f-e4db-447a-a095-dfcd7206ed1f tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] Returning 404 to user: Snapshot 077acfd1-50bc-4d58-bf64-77ee1bf1ad12 could not be found. {{(pid=125532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:41:14.102090 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-fe86217f-e4db-447a-a095-dfcd7206ed1f tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/077acfd1-50bc-4d58-bf64-77ee1bf1ad12" status: 404 len: 111 microversion: 2.1 time: 0.034099 Oct 19 00:41:14.102090 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 164/295] 10.222.0.33 () {58 vars in 1251 bytes} [Wed Oct 19 00:41:14 2022] GET /compute/v2.1/os-snapshots/077acfd1-50bc-4d58-bf64-77ee1bf1ad12 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:41:14.107257 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-5c24c23d-be04-410d-b6fb-3f29e03b1080 tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] Calling method '.version_select at 0x7f81f1122040>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:14.183950 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-5c24c23d-be04-410d-b6fb-3f29e03b1080 tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/0ac25344-499a-4161-b676-33f336769728" status: 202 len: 0 microversion: 2.1 time: 0.080171 Oct 19 00:41:14.184817 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 165/296] 10.222.0.33 () {58 vars in 1248 bytes} [Wed Oct 19 00:41:14 2022] DELETE /compute/v2.1/os-volumes/0ac25344-499a-4161-b676-33f336769728 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:41:14.194899 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-ae11f927-5644-4f49-a272-add1010ab969 tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] Calling method '.version_select at 0x7f81f1109790>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:14.236881 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-edc15b59-4e44-4691-8bd5-31bade8c825a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:14.244847 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-edc15b59-4e44-4691-8bd5-31bade8c825a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1521 microversion: 2.1 time: 0.191981 Oct 19 00:41:14.245414 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 132/297] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:14 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:14.259284 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-ae11f927-5644-4f49-a272-add1010ab969 tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/0ac25344-499a-4161-b676-33f336769728" status: 200 len: 344 microversion: 2.1 time: 0.069394 Oct 19 00:41:14.260228 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 166/298] 10.222.0.33 () {58 vars in 1245 bytes} [Wed Oct 19 00:41:14 2022] GET /compute/v2.1/os-volumes/0ac25344-499a-4161-b676-33f336769728 => generated 344 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:41:15.266956 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-0d999a2d-d120-4578-baa5-3868690ee667 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:15.268965 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-0d999a2d-d120-4578-baa5-3868690ee667 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:15.273898 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-d5e31326-08c3-4faf-8da6-a0cc215c006d tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] Calling method '.version_select at 0x7f81f1109310>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:15.274462 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0d999a2d-d120-4578-baa5-3868690ee667 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:15.275033 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0d999a2d-d120-4578-baa5-3868690ee667 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:15.275538 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0d999a2d-d120-4578-baa5-3868690ee667 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:15.276520 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0d999a2d-d120-4578-baa5-3868690ee667 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:15.277050 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0d999a2d-d120-4578-baa5-3868690ee667 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:15.277478 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0d999a2d-d120-4578-baa5-3868690ee667 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:15.293785 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell1:SELECT=100 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:15.302574 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.wsgi [None req-d5e31326-08c3-4faf-8da6-a0cc215c006d tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] HTTP exception thrown: Volume 0ac25344-499a-4161-b676-33f336769728 could not be found. Oct 19 00:41:15.304708 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-d5e31326-08c3-4faf-8da6-a0cc215c006d tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] Request method failure captured: Oct 19 00:41:15.304708 dv-cinder-master-3-smb devstack@n-api.service[125532]: request: GET /compute/v2.1/os-volumes/0ac25344-499a-4161-b676-33f336769728 HTTP/1.1 Oct 19 00:41:15.304708 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept: application/json Oct 19 00:41:15.304708 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept-Encoding: identity Oct 19 00:41:15.304708 dv-cinder-master-3-smb devstack@n-api.service[125532]: Connection: close Oct 19 00:41:15.304708 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Length: 0 Oct 19 00:41:15.304708 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Type: application/json Oct 19 00:41:15.304708 dv-cinder-master-3-smb devstack@n-api.service[125532]: Host: 10.222.0.33 Oct 19 00:41:15.304708 dv-cinder-master-3-smb devstack@n-api.service[125532]: Openstack-System-Scope: None Oct 19 00:41:15.304708 dv-cinder-master-3-smb devstack@n-api.service[125532]: User-Agent: python-urllib3/1.26.12 Oct 19 00:41:15.304708 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Auth-Token: gAAAAABjT0elfz0PTUn5Ecx5BWjHLQzgmDJ4iCwKJHW2X4Z0wFxBR34cE0qdFGwueEKsV2W_gPk4wPnuSFYBLy49APGTwNFpuDRUnY_-MltgUE6WTAmiY7BeEHLZXAU4XmYgMewSIj57m1gXG4FAcQ2FK5X5bbbcarRDhvMp_OfvCDXvzzFu_-g Oct 19 00:41:15.304708 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Id: None Oct 19 00:41:15.304708 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Name: None Oct 19 00:41:15.304708 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Identity-Status: Confirmed Oct 19 00:41:15.304708 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Is-Admin-Project: True Oct 19 00:41:15.304708 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Id: default Oct 19 00:41:15.304708 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Name: Default Oct 19 00:41:15.304708 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Id: 4cb68a88f174402d8ad45065830a7d16 Oct 19 00:41:15.304708 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-524912536 Oct 19 00:41:15.304708 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Role: member,reader Oct 19 00:41:15.304708 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Roles: member,reader Oct 19 00:41:15.306203 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4cb68a88f174402d8ad45065830a7d16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4cb68a88f174402d8ad45065830a7d16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4cb68a88f174402d8ad45065830a7d16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4cb68a88f174402d8ad45065830a7d16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:41:15.306203 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant: tempest-VolumesSnapshotsTestJSON-524912536 Oct 19 00:41:15.306203 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Id: 4cb68a88f174402d8ad45065830a7d16 Oct 19 00:41:15.306203 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-524912536 Oct 19 00:41:15.306203 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User: tempest-VolumesSnapshotsTestJSON-524912536-project Oct 19 00:41:15.306203 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Id: default Oct 19 00:41:15.306203 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Name: Default Oct 19 00:41:15.306203 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Id: 60e5ac0e700d47a2a75eeaccc35b655c Oct 19 00:41:15.306203 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Name: tempest-VolumesSnapshotsTestJSON-524912536-project Oct 19 00:41:15.306203 dv-cinder-master-3-smb devstack@n-api.service[125532]: method: Oct 19 00:41:15.306203 dv-cinder-master-3-smb devstack@n-api.service[125532]: exception: Volume 0ac25344-499a-4161-b676-33f336769728 could not be found. Oct 19 00:41:15.306203 dv-cinder-master-3-smb devstack@n-api.service[125532]: action_args: {'id': '0ac25344-499a-4161-b676-33f336769728'} Oct 19 00:41:15.306203 dv-cinder-master-3-smb devstack@n-api.service[125532]: {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:41:15.307027 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:41:15.307027 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 00:41:15.307027 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 00:41:15.307027 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 00:41:15.307027 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 00:41:15.307027 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 00:41:15.307027 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 00:41:15.307027 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 00:41:15.307027 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 00:41:15.307027 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 00:41:15.307027 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 00:41:15.307027 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 00:41:15.307027 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 00:41:15.307027 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 00:41:15.307027 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 00:41:15.307027 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0ac25344-499a-4161-b676-33f336769728 could not be found. (HTTP 404) (Request-ID: req-44ad6157-e2aa-426f-b1be-06257f2c2c8a) Oct 19 00:41:15.307027 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:15.307027 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:41:15.307027 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:15.308268 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:41:15.308268 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 19 00:41:15.308268 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 19 00:41:15.308268 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 00:41:15.308268 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 00:41:15.308268 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 00:41:15.308268 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 00:41:15.308268 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 00:41:15.308268 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 00:41:15.308268 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 00:41:15.308268 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 00:41:15.308268 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 00:41:15.308268 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 00:41:15.308268 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 00:41:15.308268 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 00:41:15.308268 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 00:41:15.308268 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 00:41:15.308268 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 00:41:15.308268 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 00:41:15.309542 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 00:41:15.309542 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 00:41:15.309542 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 00:41:15.309542 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 00:41:15.309542 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0ac25344-499a-4161-b676-33f336769728 could not be found. Oct 19 00:41:15.309542 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:15.309542 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:41:15.309542 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:15.309542 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:41:15.309542 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:41:15.309542 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:41:15.309542 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:41:15.309542 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:41:15.309542 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:41:15.309542 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:41:15.309542 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:41:15.309542 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:41:15.309542 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 19 00:41:15.309542 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:41:15.310676 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0ac25344-499a-4161-b676-33f336769728 could not be found. Oct 19 00:41:15.310676 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:15.310676 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:41:15.310676 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:15.310676 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:41:15.310676 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:41:15.310676 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:41:15.310676 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:41:15.310676 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:41:15.310676 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0ac25344-499a-4161-b676-33f336769728 could not be found. Oct 19 00:41:15.310676 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:15.310676 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-d5e31326-08c3-4faf-8da6-a0cc215c006d tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] Returning 404 to user: Volume 0ac25344-499a-4161-b676-33f336769728 could not be found. {{(pid=125532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:41:15.310676 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-d5e31326-08c3-4faf-8da6-a0cc215c006d tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/0ac25344-499a-4161-b676-33f336769728" status: 404 len: 109 microversion: 2.1 time: 0.036020 Oct 19 00:41:15.310676 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 167/299] 10.222.0.33 () {58 vars in 1245 bytes} [Wed Oct 19 00:41:15 2022] GET /compute/v2.1/os-volumes/0ac25344-499a-4161-b676-33f336769728 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 00:41:15.321326 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-d4f598c7-7a6d-4cb1-a2a2-06fe9298fd83 tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] Calling method '.version_select at 0x7f81f11228b0>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:15.353362 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.wsgi [None req-d4f598c7-7a6d-4cb1-a2a2-06fe9298fd83 tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] HTTP exception thrown: Volume 0ac25344-499a-4161-b676-33f336769728 could not be found. Oct 19 00:41:15.355304 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-d4f598c7-7a6d-4cb1-a2a2-06fe9298fd83 tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] Request method failure captured: Oct 19 00:41:15.355304 dv-cinder-master-3-smb devstack@n-api.service[125532]: request: DELETE /compute/v2.1/os-volumes/0ac25344-499a-4161-b676-33f336769728 HTTP/1.1 Oct 19 00:41:15.355304 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept: application/json Oct 19 00:41:15.355304 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept-Encoding: identity Oct 19 00:41:15.355304 dv-cinder-master-3-smb devstack@n-api.service[125532]: Connection: close Oct 19 00:41:15.355304 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Length: 0 Oct 19 00:41:15.355304 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Type: application/json Oct 19 00:41:15.355304 dv-cinder-master-3-smb devstack@n-api.service[125532]: Host: 10.222.0.33 Oct 19 00:41:15.355304 dv-cinder-master-3-smb devstack@n-api.service[125532]: Openstack-System-Scope: None Oct 19 00:41:15.355304 dv-cinder-master-3-smb devstack@n-api.service[125532]: User-Agent: python-urllib3/1.26.12 Oct 19 00:41:15.355304 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Auth-Token: gAAAAABjT0elfz0PTUn5Ecx5BWjHLQzgmDJ4iCwKJHW2X4Z0wFxBR34cE0qdFGwueEKsV2W_gPk4wPnuSFYBLy49APGTwNFpuDRUnY_-MltgUE6WTAmiY7BeEHLZXAU4XmYgMewSIj57m1gXG4FAcQ2FK5X5bbbcarRDhvMp_OfvCDXvzzFu_-g Oct 19 00:41:15.355304 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Id: None Oct 19 00:41:15.355304 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Name: None Oct 19 00:41:15.355304 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Identity-Status: Confirmed Oct 19 00:41:15.355304 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Is-Admin-Project: True Oct 19 00:41:15.355304 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Id: default Oct 19 00:41:15.355304 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Name: Default Oct 19 00:41:15.355304 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Id: 4cb68a88f174402d8ad45065830a7d16 Oct 19 00:41:15.355304 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-524912536 Oct 19 00:41:15.355304 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Role: member,reader Oct 19 00:41:15.355304 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Roles: member,reader Oct 19 00:41:15.356649 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4cb68a88f174402d8ad45065830a7d16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4cb68a88f174402d8ad45065830a7d16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4cb68a88f174402d8ad45065830a7d16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4cb68a88f174402d8ad45065830a7d16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:41:15.356649 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant: tempest-VolumesSnapshotsTestJSON-524912536 Oct 19 00:41:15.356649 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Id: 4cb68a88f174402d8ad45065830a7d16 Oct 19 00:41:15.356649 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-524912536 Oct 19 00:41:15.356649 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User: tempest-VolumesSnapshotsTestJSON-524912536-project Oct 19 00:41:15.356649 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Id: default Oct 19 00:41:15.356649 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Name: Default Oct 19 00:41:15.356649 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Id: 60e5ac0e700d47a2a75eeaccc35b655c Oct 19 00:41:15.356649 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Name: tempest-VolumesSnapshotsTestJSON-524912536-project Oct 19 00:41:15.356649 dv-cinder-master-3-smb devstack@n-api.service[125532]: method: Oct 19 00:41:15.356649 dv-cinder-master-3-smb devstack@n-api.service[125532]: exception: Volume 0ac25344-499a-4161-b676-33f336769728 could not be found. Oct 19 00:41:15.356649 dv-cinder-master-3-smb devstack@n-api.service[125532]: action_args: {'id': '0ac25344-499a-4161-b676-33f336769728'} Oct 19 00:41:15.356649 dv-cinder-master-3-smb devstack@n-api.service[125532]: {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:41:15.357365 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:41:15.357365 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 00:41:15.357365 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 00:41:15.357365 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 00:41:15.357365 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 00:41:15.357365 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 00:41:15.357365 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 00:41:15.357365 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 00:41:15.357365 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 00:41:15.357365 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 00:41:15.357365 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 00:41:15.357365 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 00:41:15.357365 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 00:41:15.357365 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 00:41:15.357365 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 00:41:15.357365 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0ac25344-499a-4161-b676-33f336769728 could not be found. (HTTP 404) (Request-ID: req-81b25951-f893-43c0-ac3e-6d3672f728a2) Oct 19 00:41:15.357365 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:15.357365 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:41:15.357365 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:15.358458 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:41:15.358458 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 19 00:41:15.358458 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 19 00:41:15.358458 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 00:41:15.358458 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 00:41:15.358458 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 00:41:15.358458 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 00:41:15.358458 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 00:41:15.358458 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 00:41:15.358458 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 00:41:15.358458 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 00:41:15.358458 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 00:41:15.358458 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 00:41:15.358458 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 00:41:15.358458 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 00:41:15.358458 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 00:41:15.358458 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 00:41:15.358458 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 00:41:15.358458 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 00:41:15.360740 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 00:41:15.360740 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 00:41:15.360740 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 00:41:15.360740 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 00:41:15.360740 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0ac25344-499a-4161-b676-33f336769728 could not be found. Oct 19 00:41:15.360740 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:15.360740 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:41:15.360740 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:15.360740 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:41:15.360740 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:41:15.360740 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:41:15.360740 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:41:15.360740 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:41:15.360740 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:41:15.360740 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:41:15.360740 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:41:15.360740 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:41:15.360740 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 19 00:41:15.360740 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:41:15.362218 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0ac25344-499a-4161-b676-33f336769728 could not be found. Oct 19 00:41:15.362218 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:15.362218 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:41:15.362218 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:15.362218 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:41:15.362218 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:41:15.362218 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:41:15.362218 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:41:15.362218 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:41:15.362218 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0ac25344-499a-4161-b676-33f336769728 could not be found. Oct 19 00:41:15.362218 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:15.362218 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-d4f598c7-7a6d-4cb1-a2a2-06fe9298fd83 tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] Returning 404 to user: Volume 0ac25344-499a-4161-b676-33f336769728 could not be found. {{(pid=125532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:41:15.362218 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-d4f598c7-7a6d-4cb1-a2a2-06fe9298fd83 tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/0ac25344-499a-4161-b676-33f336769728" status: 404 len: 109 microversion: 2.1 time: 0.039230 Oct 19 00:41:15.362218 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 168/300] 10.222.0.33 () {58 vars in 1248 bytes} [Wed Oct 19 00:41:15 2022] DELETE /compute/v2.1/os-volumes/0ac25344-499a-4161-b676-33f336769728 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 00:41:15.367461 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-8042eabe-dea0-462b-9099-eaa4a62d7d98 tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] Calling method '.version_select at 0x7f81f1109dc0>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:15.399977 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.wsgi [None req-8042eabe-dea0-462b-9099-eaa4a62d7d98 tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] HTTP exception thrown: Volume 0ac25344-499a-4161-b676-33f336769728 could not be found. Oct 19 00:41:15.402352 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-8042eabe-dea0-462b-9099-eaa4a62d7d98 tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] Request method failure captured: Oct 19 00:41:15.402352 dv-cinder-master-3-smb devstack@n-api.service[125532]: request: GET /compute/v2.1/os-volumes/0ac25344-499a-4161-b676-33f336769728 HTTP/1.1 Oct 19 00:41:15.402352 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept: application/json Oct 19 00:41:15.402352 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept-Encoding: identity Oct 19 00:41:15.402352 dv-cinder-master-3-smb devstack@n-api.service[125532]: Connection: close Oct 19 00:41:15.402352 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Length: 0 Oct 19 00:41:15.402352 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Type: application/json Oct 19 00:41:15.402352 dv-cinder-master-3-smb devstack@n-api.service[125532]: Host: 10.222.0.33 Oct 19 00:41:15.402352 dv-cinder-master-3-smb devstack@n-api.service[125532]: Openstack-System-Scope: None Oct 19 00:41:15.402352 dv-cinder-master-3-smb devstack@n-api.service[125532]: User-Agent: python-urllib3/1.26.12 Oct 19 00:41:15.402352 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Auth-Token: gAAAAABjT0elfz0PTUn5Ecx5BWjHLQzgmDJ4iCwKJHW2X4Z0wFxBR34cE0qdFGwueEKsV2W_gPk4wPnuSFYBLy49APGTwNFpuDRUnY_-MltgUE6WTAmiY7BeEHLZXAU4XmYgMewSIj57m1gXG4FAcQ2FK5X5bbbcarRDhvMp_OfvCDXvzzFu_-g Oct 19 00:41:15.402352 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Id: None Oct 19 00:41:15.402352 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Name: None Oct 19 00:41:15.402352 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Identity-Status: Confirmed Oct 19 00:41:15.402352 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Is-Admin-Project: True Oct 19 00:41:15.402352 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Id: default Oct 19 00:41:15.402352 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Name: Default Oct 19 00:41:15.402352 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Id: 4cb68a88f174402d8ad45065830a7d16 Oct 19 00:41:15.402352 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-524912536 Oct 19 00:41:15.402352 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Role: member,reader Oct 19 00:41:15.402352 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Roles: member,reader Oct 19 00:41:15.403829 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4cb68a88f174402d8ad45065830a7d16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4cb68a88f174402d8ad45065830a7d16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4cb68a88f174402d8ad45065830a7d16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4cb68a88f174402d8ad45065830a7d16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:41:15.403829 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant: tempest-VolumesSnapshotsTestJSON-524912536 Oct 19 00:41:15.403829 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Id: 4cb68a88f174402d8ad45065830a7d16 Oct 19 00:41:15.403829 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-524912536 Oct 19 00:41:15.403829 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User: tempest-VolumesSnapshotsTestJSON-524912536-project Oct 19 00:41:15.403829 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Id: default Oct 19 00:41:15.403829 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Name: Default Oct 19 00:41:15.403829 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Id: 60e5ac0e700d47a2a75eeaccc35b655c Oct 19 00:41:15.403829 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Name: tempest-VolumesSnapshotsTestJSON-524912536-project Oct 19 00:41:15.403829 dv-cinder-master-3-smb devstack@n-api.service[125532]: method: Oct 19 00:41:15.403829 dv-cinder-master-3-smb devstack@n-api.service[125532]: exception: Volume 0ac25344-499a-4161-b676-33f336769728 could not be found. Oct 19 00:41:15.403829 dv-cinder-master-3-smb devstack@n-api.service[125532]: action_args: {'id': '0ac25344-499a-4161-b676-33f336769728'} Oct 19 00:41:15.403829 dv-cinder-master-3-smb devstack@n-api.service[125532]: {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:41:15.404717 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:41:15.404717 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 00:41:15.404717 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 00:41:15.404717 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 00:41:15.404717 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 00:41:15.404717 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 00:41:15.404717 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 00:41:15.404717 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 00:41:15.404717 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 00:41:15.404717 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 00:41:15.404717 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 00:41:15.404717 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 00:41:15.404717 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 00:41:15.404717 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 00:41:15.404717 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 00:41:15.404717 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0ac25344-499a-4161-b676-33f336769728 could not be found. (HTTP 404) (Request-ID: req-1a188e09-23aa-40b5-96f1-5511a6d0463d) Oct 19 00:41:15.404717 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:15.404717 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:41:15.404717 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:15.406481 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:41:15.406481 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 19 00:41:15.406481 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 19 00:41:15.406481 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 00:41:15.406481 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 00:41:15.406481 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 00:41:15.406481 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 00:41:15.406481 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 00:41:15.406481 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 00:41:15.406481 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 00:41:15.406481 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 00:41:15.406481 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 00:41:15.406481 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 00:41:15.406481 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 00:41:15.406481 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 00:41:15.406481 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 00:41:15.406481 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 00:41:15.406481 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 00:41:15.406481 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 00:41:15.407490 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 00:41:15.407490 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 00:41:15.407490 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 00:41:15.407490 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 00:41:15.407490 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0ac25344-499a-4161-b676-33f336769728 could not be found. Oct 19 00:41:15.407490 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:15.407490 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:41:15.407490 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:15.407490 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:41:15.407490 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:41:15.407490 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:41:15.407490 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:41:15.407490 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:41:15.407490 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:41:15.407490 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:41:15.407490 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:41:15.407490 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:41:15.407490 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 19 00:41:15.407490 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:41:15.409803 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0ac25344-499a-4161-b676-33f336769728 could not be found. Oct 19 00:41:15.409803 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:15.409803 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:41:15.409803 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:15.409803 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:41:15.409803 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:41:15.409803 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:41:15.409803 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:41:15.409803 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:41:15.409803 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0ac25344-499a-4161-b676-33f336769728 could not be found. Oct 19 00:41:15.409803 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:41:15.409803 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-8042eabe-dea0-462b-9099-eaa4a62d7d98 tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] Returning 404 to user: Volume 0ac25344-499a-4161-b676-33f336769728 could not be found. {{(pid=125532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:41:15.409803 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-8042eabe-dea0-462b-9099-eaa4a62d7d98 tempest-VolumesSnapshotsTestJSON-524912536 tempest-VolumesSnapshotsTestJSON-524912536-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/0ac25344-499a-4161-b676-33f336769728" status: 404 len: 109 microversion: 2.1 time: 0.040569 Oct 19 00:41:15.409803 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 169/301] 10.222.0.33 () {58 vars in 1245 bytes} [Wed Oct 19 00:41:15 2022] GET /compute/v2.1/os-volumes/0ac25344-499a-4161-b676-33f336769728 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:41:15.674045 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-0d999a2d-d120-4578-baa5-3868690ee667 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:15.682483 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-0d999a2d-d120-4578-baa5-3868690ee667 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1521 microversion: 2.1 time: 0.419383 Oct 19 00:41:15.683746 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 133/302] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:15 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1521 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:16.707362 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-25fcb279-acef-46bf-a129-a2bb3e6e7b31 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:16.708020 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-25fcb279-acef-46bf-a129-a2bb3e6e7b31 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:16.713966 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-25fcb279-acef-46bf-a129-a2bb3e6e7b31 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:16.714436 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-25fcb279-acef-46bf-a129-a2bb3e6e7b31 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:16.714947 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-25fcb279-acef-46bf-a129-a2bb3e6e7b31 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:16.715532 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-25fcb279-acef-46bf-a129-a2bb3e6e7b31 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:16.716170 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-25fcb279-acef-46bf-a129-a2bb3e6e7b31 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:16.716810 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-25fcb279-acef-46bf-a129-a2bb3e6e7b31 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:16.856430 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-25fcb279-acef-46bf-a129-a2bb3e6e7b31 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:16.864704 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-25fcb279-acef-46bf-a129-a2bb3e6e7b31 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1521 microversion: 2.1 time: 0.162428 Oct 19 00:41:16.865448 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 170/303] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:16 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:17.889263 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-d634c668-ed67-4470-9d1d-61e98f8ffd12 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:17.889920 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-d634c668-ed67-4470-9d1d-61e98f8ffd12 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:17.906458 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d634c668-ed67-4470-9d1d-61e98f8ffd12 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:17.906960 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d634c668-ed67-4470-9d1d-61e98f8ffd12 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:17.907406 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d634c668-ed67-4470-9d1d-61e98f8ffd12 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:17.908153 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d634c668-ed67-4470-9d1d-61e98f8ffd12 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:17.908638 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d634c668-ed67-4470-9d1d-61e98f8ffd12 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:17.909065 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d634c668-ed67-4470-9d1d-61e98f8ffd12 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:18.042752 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-d634c668-ed67-4470-9d1d-61e98f8ffd12 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:18.051475 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-d634c668-ed67-4470-9d1d-61e98f8ffd12 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1521 microversion: 2.1 time: 0.166000 Oct 19 00:41:18.052039 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 134/304] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:17 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:19.075883 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-ddaccbbd-7dfa-4a0e-b1a9-c278d7897192 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:19.076519 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-ddaccbbd-7dfa-4a0e-b1a9-c278d7897192 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:19.083842 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ddaccbbd-7dfa-4a0e-b1a9-c278d7897192 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:19.084363 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ddaccbbd-7dfa-4a0e-b1a9-c278d7897192 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:19.084805 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ddaccbbd-7dfa-4a0e-b1a9-c278d7897192 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:19.085512 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ddaccbbd-7dfa-4a0e-b1a9-c278d7897192 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:19.085968 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ddaccbbd-7dfa-4a0e-b1a9-c278d7897192 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:19.086395 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ddaccbbd-7dfa-4a0e-b1a9-c278d7897192 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:19.239908 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-ddaccbbd-7dfa-4a0e-b1a9-c278d7897192 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:19.250839 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-ddaccbbd-7dfa-4a0e-b1a9-c278d7897192 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1521 microversion: 2.1 time: 0.177320 Oct 19 00:41:19.251692 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 171/305] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:19 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:20.274995 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-07d9cf7d-896f-4684-9831-93ed7b86cf60 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:20.275707 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-07d9cf7d-896f-4684-9831-93ed7b86cf60 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:20.283934 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-07d9cf7d-896f-4684-9831-93ed7b86cf60 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:20.284411 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-07d9cf7d-896f-4684-9831-93ed7b86cf60 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:20.284848 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-07d9cf7d-896f-4684-9831-93ed7b86cf60 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:20.285530 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-07d9cf7d-896f-4684-9831-93ed7b86cf60 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:20.285977 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-07d9cf7d-896f-4684-9831-93ed7b86cf60 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:20.286392 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-07d9cf7d-896f-4684-9831-93ed7b86cf60 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:20.419145 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-07d9cf7d-896f-4684-9831-93ed7b86cf60 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:20.428092 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-07d9cf7d-896f-4684-9831-93ed7b86cf60 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1521 microversion: 2.1 time: 0.157310 Oct 19 00:41:20.428938 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 135/306] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:20 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:21.462027 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-788b7845-55b4-42a9-9419-1bc858c86dd5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:21.462629 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-788b7845-55b4-42a9-9419-1bc858c86dd5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:21.468891 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-788b7845-55b4-42a9-9419-1bc858c86dd5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:21.469363 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-788b7845-55b4-42a9-9419-1bc858c86dd5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:21.469791 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-788b7845-55b4-42a9-9419-1bc858c86dd5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:21.470472 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-788b7845-55b4-42a9-9419-1bc858c86dd5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:21.470921 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-788b7845-55b4-42a9-9419-1bc858c86dd5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:21.471341 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-788b7845-55b4-42a9-9419-1bc858c86dd5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:21.600270 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-788b7845-55b4-42a9-9419-1bc858c86dd5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:21.607938 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-788b7845-55b4-42a9-9419-1bc858c86dd5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1521 microversion: 2.1 time: 0.149797 Oct 19 00:41:21.608502 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 172/307] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:21 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:22.633051 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-8870b714-2c80-4933-bb9f-9a99846d1ccc tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:22.633659 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-8870b714-2c80-4933-bb9f-9a99846d1ccc tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:22.640617 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8870b714-2c80-4933-bb9f-9a99846d1ccc tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:22.641094 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8870b714-2c80-4933-bb9f-9a99846d1ccc tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:22.641526 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8870b714-2c80-4933-bb9f-9a99846d1ccc tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:22.642203 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8870b714-2c80-4933-bb9f-9a99846d1ccc tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:22.642650 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8870b714-2c80-4933-bb9f-9a99846d1ccc tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:22.643066 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8870b714-2c80-4933-bb9f-9a99846d1ccc tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:22.769640 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-8870b714-2c80-4933-bb9f-9a99846d1ccc tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:22.777262 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-8870b714-2c80-4933-bb9f-9a99846d1ccc tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1521 microversion: 2.1 time: 0.148092 Oct 19 00:41:22.777833 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 136/308] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:22 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:23.800946 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-c59d2971-e735-4881-b389-9ef49a850a3f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:23.801580 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-c59d2971-e735-4881-b389-9ef49a850a3f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:23.805567 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:23.809503 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c59d2971-e735-4881-b389-9ef49a850a3f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:23.809997 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c59d2971-e735-4881-b389-9ef49a850a3f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:23.810434 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c59d2971-e735-4881-b389-9ef49a850a3f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:23.811137 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c59d2971-e735-4881-b389-9ef49a850a3f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:23.811591 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c59d2971-e735-4881-b389-9ef49a850a3f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:23.812620 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c59d2971-e735-4881-b389-9ef49a850a3f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:24.255553 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-c59d2971-e735-4881-b389-9ef49a850a3f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:24.263578 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-c59d2971-e735-4881-b389-9ef49a850a3f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1521 microversion: 2.1 time: 0.466826 Oct 19 00:41:24.264353 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 173/309] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:23 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1521 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:25.287248 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-357496e7-adf2-4dcb-9bd9-d656212f11bb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:25.287989 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-357496e7-adf2-4dcb-9bd9-d656212f11bb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:25.294495 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-357496e7-adf2-4dcb-9bd9-d656212f11bb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:25.294976 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-357496e7-adf2-4dcb-9bd9-d656212f11bb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:25.295440 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-357496e7-adf2-4dcb-9bd9-d656212f11bb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:25.296829 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-357496e7-adf2-4dcb-9bd9-d656212f11bb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:25.297413 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-357496e7-adf2-4dcb-9bd9-d656212f11bb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:25.297826 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-357496e7-adf2-4dcb-9bd9-d656212f11bb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:25.435824 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-357496e7-adf2-4dcb-9bd9-d656212f11bb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:25.443770 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-357496e7-adf2-4dcb-9bd9-d656212f11bb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1521 microversion: 2.1 time: 0.160316 Oct 19 00:41:25.444394 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 137/310] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:25 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:26.468938 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-82331444-911b-4ab9-89c9-08238b04d813 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:26.470442 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-82331444-911b-4ab9-89c9-08238b04d813 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:26.477529 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-82331444-911b-4ab9-89c9-08238b04d813 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:26.478022 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-82331444-911b-4ab9-89c9-08238b04d813 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:26.478480 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-82331444-911b-4ab9-89c9-08238b04d813 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:26.479191 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-82331444-911b-4ab9-89c9-08238b04d813 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:26.479688 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-82331444-911b-4ab9-89c9-08238b04d813 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:26.480125 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-82331444-911b-4ab9-89c9-08238b04d813 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:26.637459 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-82331444-911b-4ab9-89c9-08238b04d813 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:26.646560 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-82331444-911b-4ab9-89c9-08238b04d813 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1521 microversion: 2.1 time: 0.183224 Oct 19 00:41:26.647231 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 174/311] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:26 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:27.670585 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-d9444a25-6c94-476a-b32b-2a58bda186e1 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:27.671152 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-d9444a25-6c94-476a-b32b-2a58bda186e1 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:27.685708 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d9444a25-6c94-476a-b32b-2a58bda186e1 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:27.686339 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d9444a25-6c94-476a-b32b-2a58bda186e1 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:27.686882 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d9444a25-6c94-476a-b32b-2a58bda186e1 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:27.687772 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d9444a25-6c94-476a-b32b-2a58bda186e1 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:27.688261 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d9444a25-6c94-476a-b32b-2a58bda186e1 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:27.688689 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d9444a25-6c94-476a-b32b-2a58bda186e1 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:27.903092 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-d9444a25-6c94-476a-b32b-2a58bda186e1 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:27.907674 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-d9444a25-6c94-476a-b32b-2a58bda186e1 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1521 microversion: 2.1 time: 0.241223 Oct 19 00:41:27.908294 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 138/312] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:27 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:28.930339 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-dafd8d7a-bf1d-4774-86eb-fc1d97ca60e4 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:28.930953 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-dafd8d7a-bf1d-4774-86eb-fc1d97ca60e4 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:28.937169 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dafd8d7a-bf1d-4774-86eb-fc1d97ca60e4 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:28.937684 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dafd8d7a-bf1d-4774-86eb-fc1d97ca60e4 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:28.938118 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dafd8d7a-bf1d-4774-86eb-fc1d97ca60e4 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:28.938816 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dafd8d7a-bf1d-4774-86eb-fc1d97ca60e4 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:28.939267 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dafd8d7a-bf1d-4774-86eb-fc1d97ca60e4 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:28.939688 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dafd8d7a-bf1d-4774-86eb-fc1d97ca60e4 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:29.071488 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-dafd8d7a-bf1d-4774-86eb-fc1d97ca60e4 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:29.074966 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:29.080762 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-dafd8d7a-bf1d-4774-86eb-fc1d97ca60e4 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1521 microversion: 2.1 time: 0.154191 Oct 19 00:41:29.081589 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 175/313] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:28 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:41:30.105376 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-dae0a1a7-a326-4f6b-8f31-0b248fdc73de tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:30.105994 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-dae0a1a7-a326-4f6b-8f31-0b248fdc73de tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:30.113513 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dae0a1a7-a326-4f6b-8f31-0b248fdc73de tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:30.113999 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dae0a1a7-a326-4f6b-8f31-0b248fdc73de tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:30.114435 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dae0a1a7-a326-4f6b-8f31-0b248fdc73de tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:30.115133 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dae0a1a7-a326-4f6b-8f31-0b248fdc73de tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:30.115582 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dae0a1a7-a326-4f6b-8f31-0b248fdc73de tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:30.116111 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dae0a1a7-a326-4f6b-8f31-0b248fdc73de tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:30.254724 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-dae0a1a7-a326-4f6b-8f31-0b248fdc73de tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:30.262396 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-dae0a1a7-a326-4f6b-8f31-0b248fdc73de tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1501 microversion: 2.1 time: 0.161157 Oct 19 00:41:30.262961 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 139/314] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:30 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1501 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:30.286293 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-cfd1b423-27a2-4a18-b65b-3a6b92d6429b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:30.286897 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-cfd1b423-27a2-4a18-b65b-3a6b92d6429b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4389c416-28bf-4b8e-945e-386f38c16859] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:30.293903 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cfd1b423-27a2-4a18-b65b-3a6b92d6429b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:30.294380 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cfd1b423-27a2-4a18-b65b-3a6b92d6429b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:30.294808 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cfd1b423-27a2-4a18-b65b-3a6b92d6429b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:30.295491 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cfd1b423-27a2-4a18-b65b-3a6b92d6429b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:30.296003 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cfd1b423-27a2-4a18-b65b-3a6b92d6429b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:30.296910 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cfd1b423-27a2-4a18-b65b-3a6b92d6429b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:30.429559 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-cfd1b423-27a2-4a18-b65b-3a6b92d6429b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:30.438153 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-cfd1b423-27a2-4a18-b65b-3a6b92d6429b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859" status: 200 len: 1516 microversion: 2.1 time: 0.155973 Oct 19 00:41:30.438712 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 176/315] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:30 2022] GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:31.864410 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-21ff3dbe-3e17-4b71-9139-c1adff1ce031 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:41:31.866811 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-21ff3dbe-3e17-4b71-9139-c1adff1ce031 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4389c416-28bf-4b8e-945e-386f38c16859] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:31.872827 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-21ff3dbe-3e17-4b71-9139-c1adff1ce031 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:31.873310 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-21ff3dbe-3e17-4b71-9139-c1adff1ce031 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:31.873748 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-21ff3dbe-3e17-4b71-9139-c1adff1ce031 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:31.874980 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-21ff3dbe-3e17-4b71-9139-c1adff1ce031 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:31.875432 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-21ff3dbe-3e17-4b71-9139-c1adff1ce031 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:31.875883 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-21ff3dbe-3e17-4b71-9139-c1adff1ce031 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:31.899551 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.objects.instance [None req-21ff3dbe-3e17-4b71-9139-c1adff1ce031 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lazy-loading 'flavor' on Instance uuid 4389c416-28bf-4b8e-945e-386f38c16859 {{(pid=125531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:41:31.970468 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-21ff3dbe-3e17-4b71-9139-c1adff1ce031 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "POST /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859/action" status: 200 len: 32 microversion: 2.1 time: 0.110269 Oct 19 00:41:31.971064 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 140/316] 10.222.0.33 () {60 vars in 1278 bytes} [Wed Oct 19 00:41:31 2022] POST /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859/action => generated 32 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 19 00:41:31.980871 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-c64e230a-b05b-4b58-9323-8194f18ec7bf tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:31.981487 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-c64e230a-b05b-4b58-9323-8194f18ec7bf tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4389c416-28bf-4b8e-945e-386f38c16859] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:31.990459 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c64e230a-b05b-4b58-9323-8194f18ec7bf tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:31.991151 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c64e230a-b05b-4b58-9323-8194f18ec7bf tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:31.991522 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c64e230a-b05b-4b58-9323-8194f18ec7bf tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:31.992442 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c64e230a-b05b-4b58-9323-8194f18ec7bf tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:31.992922 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c64e230a-b05b-4b58-9323-8194f18ec7bf tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:31.993332 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c64e230a-b05b-4b58-9323-8194f18ec7bf tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:32.123989 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-c64e230a-b05b-4b58-9323-8194f18ec7bf tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:32.132298 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-c64e230a-b05b-4b58-9323-8194f18ec7bf tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859" status: 200 len: 1522 microversion: 2.1 time: 0.155416 Oct 19 00:41:32.132864 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 177/317] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:31 2022] GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:33.159088 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-b6337531-4eed-4c75-9598-1de2a4b07da0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:33.159788 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-b6337531-4eed-4c75-9598-1de2a4b07da0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4389c416-28bf-4b8e-945e-386f38c16859] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:33.161750 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_api:SELECT=55 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:33.167506 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b6337531-4eed-4c75-9598-1de2a4b07da0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:33.168018 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b6337531-4eed-4c75-9598-1de2a4b07da0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:33.168449 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b6337531-4eed-4c75-9598-1de2a4b07da0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:33.169139 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b6337531-4eed-4c75-9598-1de2a4b07da0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:33.169591 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b6337531-4eed-4c75-9598-1de2a4b07da0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:33.170015 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b6337531-4eed-4c75-9598-1de2a4b07da0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:33.306286 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-b6337531-4eed-4c75-9598-1de2a4b07da0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:33.315728 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-b6337531-4eed-4c75-9598-1de2a4b07da0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859" status: 200 len: 1522 microversion: 2.1 time: 0.161696 Oct 19 00:41:33.316329 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 141/318] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:33 2022] GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:34.340406 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-2168b8e6-bdde-4b7c-80a6-00c0e97bc07a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:34.341018 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-2168b8e6-bdde-4b7c-80a6-00c0e97bc07a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4389c416-28bf-4b8e-945e-386f38c16859] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:34.347724 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2168b8e6-bdde-4b7c-80a6-00c0e97bc07a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:34.348241 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2168b8e6-bdde-4b7c-80a6-00c0e97bc07a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:34.348679 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2168b8e6-bdde-4b7c-80a6-00c0e97bc07a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:34.349373 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2168b8e6-bdde-4b7c-80a6-00c0e97bc07a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:34.349838 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2168b8e6-bdde-4b7c-80a6-00c0e97bc07a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:34.350267 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2168b8e6-bdde-4b7c-80a6-00c0e97bc07a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:34.480856 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-2168b8e6-bdde-4b7c-80a6-00c0e97bc07a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:34.488858 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-2168b8e6-bdde-4b7c-80a6-00c0e97bc07a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859" status: 200 len: 1522 microversion: 2.1 time: 0.152308 Oct 19 00:41:34.489416 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 178/319] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:34 2022] GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:35.510588 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-802c4e8a-d156-4ec4-981f-8183e68d2906 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:35.511256 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-802c4e8a-d156-4ec4-981f-8183e68d2906 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4389c416-28bf-4b8e-945e-386f38c16859] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:35.517769 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-802c4e8a-d156-4ec4-981f-8183e68d2906 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:35.518245 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-802c4e8a-d156-4ec4-981f-8183e68d2906 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:35.518682 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-802c4e8a-d156-4ec4-981f-8183e68d2906 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:35.519369 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-802c4e8a-d156-4ec4-981f-8183e68d2906 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:35.519820 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-802c4e8a-d156-4ec4-981f-8183e68d2906 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:35.520268 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-802c4e8a-d156-4ec4-981f-8183e68d2906 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:35.650401 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-802c4e8a-d156-4ec4-981f-8183e68d2906 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:35.658728 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-802c4e8a-d156-4ec4-981f-8183e68d2906 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859" status: 200 len: 1522 microversion: 2.1 time: 0.152067 Oct 19 00:41:35.659296 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 142/320] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:35 2022] GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:36.682138 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-6cf05e9f-4f37-422a-b0d3-5b8beac6092e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:36.683987 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-6cf05e9f-4f37-422a-b0d3-5b8beac6092e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4389c416-28bf-4b8e-945e-386f38c16859] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:36.693600 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6cf05e9f-4f37-422a-b0d3-5b8beac6092e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:36.694530 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6cf05e9f-4f37-422a-b0d3-5b8beac6092e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:36.694973 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6cf05e9f-4f37-422a-b0d3-5b8beac6092e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:36.696184 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6cf05e9f-4f37-422a-b0d3-5b8beac6092e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:36.696890 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6cf05e9f-4f37-422a-b0d3-5b8beac6092e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:36.697476 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6cf05e9f-4f37-422a-b0d3-5b8beac6092e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:36.869586 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-6cf05e9f-4f37-422a-b0d3-5b8beac6092e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:36.878467 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-6cf05e9f-4f37-422a-b0d3-5b8beac6092e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859" status: 200 len: 1522 microversion: 2.1 time: 0.200445 Oct 19 00:41:36.879042 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 179/321] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:36 2022] GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:37.902123 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-8e5c600f-fe8e-42af-ad19-4228ecf2f281 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:37.902615 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-8e5c600f-fe8e-42af-ad19-4228ecf2f281 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4389c416-28bf-4b8e-945e-386f38c16859] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:37.909962 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8e5c600f-fe8e-42af-ad19-4228ecf2f281 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:37.910662 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8e5c600f-fe8e-42af-ad19-4228ecf2f281 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:37.911108 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8e5c600f-fe8e-42af-ad19-4228ecf2f281 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:37.911809 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8e5c600f-fe8e-42af-ad19-4228ecf2f281 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:37.912298 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8e5c600f-fe8e-42af-ad19-4228ecf2f281 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:37.912718 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8e5c600f-fe8e-42af-ad19-4228ecf2f281 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:38.083388 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-8e5c600f-fe8e-42af-ad19-4228ecf2f281 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:38.091252 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-8e5c600f-fe8e-42af-ad19-4228ecf2f281 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859" status: 200 len: 1522 microversion: 2.1 time: 0.193933 Oct 19 00:41:38.092306 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 143/322] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:37 2022] GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:39.115580 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-dd017992-50f4-4b2b-90d4-46d44de45250 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:39.116631 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-dd017992-50f4-4b2b-90d4-46d44de45250 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4389c416-28bf-4b8e-945e-386f38c16859] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:39.126840 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dd017992-50f4-4b2b-90d4-46d44de45250 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:39.127414 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dd017992-50f4-4b2b-90d4-46d44de45250 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:39.128083 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dd017992-50f4-4b2b-90d4-46d44de45250 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:39.128955 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dd017992-50f4-4b2b-90d4-46d44de45250 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:39.129761 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dd017992-50f4-4b2b-90d4-46d44de45250 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:39.130516 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dd017992-50f4-4b2b-90d4-46d44de45250 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:39.286891 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-dd017992-50f4-4b2b-90d4-46d44de45250 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:39.294575 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-dd017992-50f4-4b2b-90d4-46d44de45250 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859" status: 200 len: 1522 microversion: 2.1 time: 0.182889 Oct 19 00:41:39.295141 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 180/323] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:39 2022] GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:40.319679 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-ba3cbeb4-5152-4264-b7df-faab7307e380 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:40.320484 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-ba3cbeb4-5152-4264-b7df-faab7307e380 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4389c416-28bf-4b8e-945e-386f38c16859] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:40.328750 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ba3cbeb4-5152-4264-b7df-faab7307e380 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:40.329371 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ba3cbeb4-5152-4264-b7df-faab7307e380 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:40.330035 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ba3cbeb4-5152-4264-b7df-faab7307e380 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:40.330850 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ba3cbeb4-5152-4264-b7df-faab7307e380 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:40.331748 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ba3cbeb4-5152-4264-b7df-faab7307e380 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:40.332401 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ba3cbeb4-5152-4264-b7df-faab7307e380 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:40.495775 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-ba3cbeb4-5152-4264-b7df-faab7307e380 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:40.506427 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-ba3cbeb4-5152-4264-b7df-faab7307e380 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859" status: 200 len: 1522 microversion: 2.1 time: 0.192237 Oct 19 00:41:40.512023 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 144/324] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:40 2022] GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:41.530124 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-ce53377c-582b-4e28-9db0-50c65574565a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:41.531571 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-ce53377c-582b-4e28-9db0-50c65574565a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4389c416-28bf-4b8e-945e-386f38c16859] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:41.537917 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ce53377c-582b-4e28-9db0-50c65574565a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:41.538547 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ce53377c-582b-4e28-9db0-50c65574565a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:41.539087 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ce53377c-582b-4e28-9db0-50c65574565a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:41.539819 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ce53377c-582b-4e28-9db0-50c65574565a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:41.540373 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ce53377c-582b-4e28-9db0-50c65574565a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:41.540802 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ce53377c-582b-4e28-9db0-50c65574565a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:41.680435 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-ce53377c-582b-4e28-9db0-50c65574565a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:41.697572 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-ce53377c-582b-4e28-9db0-50c65574565a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859" status: 200 len: 1522 microversion: 2.1 time: 0.170926 Oct 19 00:41:41.697794 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 181/325] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:41 2022] GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:42.720709 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-9431d5e7-86ad-45ec-a9a2-91185ca11b06 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:42.721538 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-9431d5e7-86ad-45ec-a9a2-91185ca11b06 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4389c416-28bf-4b8e-945e-386f38c16859] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:42.728350 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9431d5e7-86ad-45ec-a9a2-91185ca11b06 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:42.728834 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9431d5e7-86ad-45ec-a9a2-91185ca11b06 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:42.729270 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9431d5e7-86ad-45ec-a9a2-91185ca11b06 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:42.729969 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9431d5e7-86ad-45ec-a9a2-91185ca11b06 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:42.730422 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9431d5e7-86ad-45ec-a9a2-91185ca11b06 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:42.730845 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9431d5e7-86ad-45ec-a9a2-91185ca11b06 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:42.879288 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-9431d5e7-86ad-45ec-a9a2-91185ca11b06 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:42.886968 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-9431d5e7-86ad-45ec-a9a2-91185ca11b06 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859" status: 200 len: 1522 microversion: 2.1 time: 0.171041 Oct 19 00:41:42.887612 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 145/326] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:42 2022] GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:43.911654 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-723eaf51-0f63-4629-bc4c-94d2c7932de5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:43.912516 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-723eaf51-0f63-4629-bc4c-94d2c7932de5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4389c416-28bf-4b8e-945e-386f38c16859] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:43.918664 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-723eaf51-0f63-4629-bc4c-94d2c7932de5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:43.919151 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-723eaf51-0f63-4629-bc4c-94d2c7932de5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:43.919747 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-723eaf51-0f63-4629-bc4c-94d2c7932de5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:43.920570 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-723eaf51-0f63-4629-bc4c-94d2c7932de5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:43.921223 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-723eaf51-0f63-4629-bc4c-94d2c7932de5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:43.921658 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-723eaf51-0f63-4629-bc4c-94d2c7932de5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:44.055234 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-723eaf51-0f63-4629-bc4c-94d2c7932de5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:44.064602 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-723eaf51-0f63-4629-bc4c-94d2c7932de5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859" status: 200 len: 1522 microversion: 2.1 time: 0.157681 Oct 19 00:41:44.065199 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 182/327] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:43 2022] GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:45.089091 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-81de5706-1fb0-45a2-a880-e6123e393ff4 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:45.089703 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-81de5706-1fb0-45a2-a880-e6123e393ff4 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4389c416-28bf-4b8e-945e-386f38c16859] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:45.095649 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-81de5706-1fb0-45a2-a880-e6123e393ff4 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:45.096156 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-81de5706-1fb0-45a2-a880-e6123e393ff4 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:45.096591 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-81de5706-1fb0-45a2-a880-e6123e393ff4 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:45.097279 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-81de5706-1fb0-45a2-a880-e6123e393ff4 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:45.097729 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-81de5706-1fb0-45a2-a880-e6123e393ff4 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:45.098239 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-81de5706-1fb0-45a2-a880-e6123e393ff4 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:45.231068 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-81de5706-1fb0-45a2-a880-e6123e393ff4 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:45.239593 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-81de5706-1fb0-45a2-a880-e6123e393ff4 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859" status: 200 len: 1522 microversion: 2.1 time: 0.155034 Oct 19 00:41:45.240194 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 146/328] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:45 2022] GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:45.876787 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-cfcf7a91-dfe1-4705-b965-a2b44228de84 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1306491742", "imageRef": "d1f4abc9-3bb9-4343-9a05-53d758070c9d", "flavorRef": "452", "networks": [{"uuid": "7717f719-24dc-492e-93d6-b020602becc4"}]}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:41:45.933478 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.network.neutron [None req-cfcf7a91-dfe1-4705-b965-a2b44228de84 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] validate_networks() for [('7717f719-24dc-492e-93d6-b020602becc4', None, None, None, None, None)] {{(pid=125532) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:41:46.262853 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-f584ce5a-4181-4551-97c2-d1e70f10b668 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:46.263652 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-f584ce5a-4181-4551-97c2-d1e70f10b668 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4389c416-28bf-4b8e-945e-386f38c16859] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:46.270865 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f584ce5a-4181-4551-97c2-d1e70f10b668 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:46.271608 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f584ce5a-4181-4551-97c2-d1e70f10b668 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:46.272240 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f584ce5a-4181-4551-97c2-d1e70f10b668 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:46.272978 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f584ce5a-4181-4551-97c2-d1e70f10b668 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:46.273435 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f584ce5a-4181-4551-97c2-d1e70f10b668 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:46.273871 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f584ce5a-4181-4551-97c2-d1e70f10b668 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:46.276775 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:46.277733 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-cfcf7a91-dfe1-4705-b965-a2b44228de84 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Flavor limits 0:0:0 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:41:46.278207 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-cfcf7a91-dfe1-4705-b965-a2b44228de84 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Image limits 0:0:0 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:41:46.278890 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-cfcf7a91-dfe1-4705-b965-a2b44228de84 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Flavor pref 0:0:0 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:41:46.279460 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-cfcf7a91-dfe1-4705-b965-a2b44228de84 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Image pref 0:0:0 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:41:46.279892 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-cfcf7a91-dfe1-4705-b965-a2b44228de84 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:41:46.289217 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cfcf7a91-dfe1-4705-b965-a2b44228de84 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:46.289690 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cfcf7a91-dfe1-4705-b965-a2b44228de84 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:46.290116 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cfcf7a91-dfe1-4705-b965-a2b44228de84 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:46.290994 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cfcf7a91-dfe1-4705-b965-a2b44228de84 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:46.291515 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cfcf7a91-dfe1-4705-b965-a2b44228de84 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:46.292123 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cfcf7a91-dfe1-4705-b965-a2b44228de84 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:46.309120 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.quota [None req-cfcf7a91-dfe1-4705-b965-a2b44228de84 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Getting quotas for project 3b24d4afc5104b359924acdf4619cfc7. Resources: {'instances', 'cores', 'ram'} {{(pid=125532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:41:46.313939 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.quota [None req-cfcf7a91-dfe1-4705-b965-a2b44228de84 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Getting quotas for user bb1e83f51a384b7d9d044bce87f00990 and project 3b24d4afc5104b359924acdf4619cfc7. Resources: {'instances', 'cores', 'ram'} {{(pid=125532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:41:46.325111 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-cfcf7a91-dfe1-4705-b965-a2b44228de84 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Going to run 1 instances... {{(pid=125532) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:41:46.328101 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-cfcf7a91-dfe1-4705-b965-a2b44228de84 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 04a968fc-e77d-4848-b28e-98db63fb2eea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1f4abc9-3bb9-4343-9a05-53d758070c9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125532) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:41:46.375469 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-cfcf7a91-dfe1-4705-b965-a2b44228de84 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.502758 Oct 19 00:41:46.383268 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 183/329] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Oct 19 00:41:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:41:46.388095 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-8d92780e-0a1c-48f3-b0da-d4b5a863ec0b tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:46.388713 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-8d92780e-0a1c-48f3-b0da-d4b5a863ec0b tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 04a968fc-e77d-4848-b28e-98db63fb2eea] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:46.414467 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-f584ce5a-4181-4551-97c2-d1e70f10b668 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:46.423947 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-f584ce5a-4181-4551-97c2-d1e70f10b668 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859" status: 200 len: 1522 microversion: 2.1 time: 0.163968 Oct 19 00:41:46.423947 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 147/330] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:46 2022] GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:41:46.447591 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-8d92780e-0a1c-48f3-b0da-d4b5a863ec0b tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:46.455031 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-8d92780e-0a1c-48f3-b0da-d4b5a863ec0b tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea" status: 200 len: 1219 microversion: 2.1 time: 0.070684 Oct 19 00:41:46.455596 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 184/331] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:46 2022] GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:47.446294 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-f8ef0814-b0d5-4845-888a-ab5105e3b417 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:47.446896 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-f8ef0814-b0d5-4845-888a-ab5105e3b417 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4389c416-28bf-4b8e-945e-386f38c16859] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:47.453874 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f8ef0814-b0d5-4845-888a-ab5105e3b417 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:47.454355 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f8ef0814-b0d5-4845-888a-ab5105e3b417 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:47.454794 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f8ef0814-b0d5-4845-888a-ab5105e3b417 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:47.455479 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f8ef0814-b0d5-4845-888a-ab5105e3b417 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:47.455959 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f8ef0814-b0d5-4845-888a-ab5105e3b417 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:47.456383 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f8ef0814-b0d5-4845-888a-ab5105e3b417 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:47.477724 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-0db67c9a-5398-4486-87c4-487581fb88ca tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:47.478955 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-0db67c9a-5398-4486-87c4-487581fb88ca tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 04a968fc-e77d-4848-b28e-98db63fb2eea] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:47.607803 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-f8ef0814-b0d5-4845-888a-ab5105e3b417 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:47.617487 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-f8ef0814-b0d5-4845-888a-ab5105e3b417 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859" status: 200 len: 1502 microversion: 2.1 time: 0.175106 Oct 19 00:41:47.618072 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 148/332] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:47 2022] GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859 => generated 1502 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:47.628651 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0db67c9a-5398-4486-87c4-487581fb88ca tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:47.629348 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0db67c9a-5398-4486-87c4-487581fb88ca tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:47.629957 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0db67c9a-5398-4486-87c4-487581fb88ca tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:47.630849 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0db67c9a-5398-4486-87c4-487581fb88ca tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:47.631309 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0db67c9a-5398-4486-87c4-487581fb88ca tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:47.631739 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0db67c9a-5398-4486-87c4-487581fb88ca tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:47.642969 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-5094cdb6-99ed-4f8c-ad6b-6ef0321f4e3d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "707a5ab7-7166-457e-8700-cbbfc0a81a04"}} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:41:47.645536 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-5094cdb6-99ed-4f8c-ad6b-6ef0321f4e3d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4389c416-28bf-4b8e-945e-386f38c16859] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:47.652306 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5094cdb6-99ed-4f8c-ad6b-6ef0321f4e3d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:47.652900 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5094cdb6-99ed-4f8c-ad6b-6ef0321f4e3d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:47.653392 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5094cdb6-99ed-4f8c-ad6b-6ef0321f4e3d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:47.654206 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5094cdb6-99ed-4f8c-ad6b-6ef0321f4e3d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:47.654795 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5094cdb6-99ed-4f8c-ad6b-6ef0321f4e3d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:47.655787 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5094cdb6-99ed-4f8c-ad6b-6ef0321f4e3d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:47.685072 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.wsgi [None req-5094cdb6-99ed-4f8c-ad6b-6ef0321f4e3d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] HTTP exception thrown: Cannot 'attach_volume' instance 4389c416-28bf-4b8e-945e-386f38c16859 while it is in vm_state rescued Oct 19 00:41:47.687474 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-5094cdb6-99ed-4f8c-ad6b-6ef0321f4e3d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Request method failure captured: Oct 19 00:41:47.687474 dv-cinder-master-3-smb devstack@n-api.service[125531]: request: POST /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859/os-volume_attachments HTTP/1.1 Oct 19 00:41:47.687474 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept: application/json Oct 19 00:41:47.687474 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept-Encoding: identity Oct 19 00:41:47.687474 dv-cinder-master-3-smb devstack@n-api.service[125531]: Connection: close Oct 19 00:41:47.687474 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Length: 74 Oct 19 00:41:47.687474 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Type: application/json Oct 19 00:41:47.687474 dv-cinder-master-3-smb devstack@n-api.service[125531]: Host: 10.222.0.33 Oct 19 00:41:47.687474 dv-cinder-master-3-smb devstack@n-api.service[125531]: Openstack-System-Scope: None Oct 19 00:41:47.687474 dv-cinder-master-3-smb devstack@n-api.service[125531]: User-Agent: python-urllib3/1.26.12 Oct 19 00:41:47.687474 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Auth-Token: gAAAAABjT0dZ_4FF8isbZtl7c5-GdMjgtdkzBRByQoOzSTUxRPm0NU1bMkTSg3nCD_LApNQSolFnUFcfFlewlCxUoOsWoj9qCOzOsCRlZMSRn6X12ufFgLR_KoHBG97yFQ-9UyMgZvW2127GxTVAcAuSg_loWUS1yl5fwx-10demwDus7CXkRQ8 Oct 19 00:41:47.687474 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Id: None Oct 19 00:41:47.687474 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Name: None Oct 19 00:41:47.687474 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Identity-Status: Confirmed Oct 19 00:41:47.687474 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Is-Admin-Project: True Oct 19 00:41:47.687474 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Id: default Oct 19 00:41:47.687474 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Name: Default Oct 19 00:41:47.687474 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Id: 5a230211180742ef9efd4d62b630d211 Oct 19 00:41:47.687474 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-748606272 Oct 19 00:41:47.687474 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Role: member,reader Oct 19 00:41:47.687474 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Roles: member,reader Oct 19 00:41:47.688874 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a230211180742ef9efd4d62b630d211"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a230211180742ef9efd4d62b630d211"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a230211180742ef9efd4d62b630d211"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a230211180742ef9efd4d62b630d211"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:41:47.688874 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant: tempest-ServerRescueNegativeTestJSON-748606272 Oct 19 00:41:47.688874 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Id: 5a230211180742ef9efd4d62b630d211 Oct 19 00:41:47.688874 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-748606272 Oct 19 00:41:47.688874 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User: tempest-ServerRescueNegativeTestJSON-748606272-project Oct 19 00:41:47.688874 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Id: default Oct 19 00:41:47.688874 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Name: Default Oct 19 00:41:47.688874 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Id: 5628a861c90042d88b95f2d7b898ed52 Oct 19 00:41:47.688874 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Name: tempest-ServerRescueNegativeTestJSON-748606272-project Oct 19 00:41:47.688874 dv-cinder-master-3-smb devstack@n-api.service[125531]: Oct 19 00:41:47.688874 dv-cinder-master-3-smb devstack@n-api.service[125531]: {"volumeAttachment": {"volumeId": "707a5ab7-7166-457e-8700-cbbfc0a81a04"}} Oct 19 00:41:47.688874 dv-cinder-master-3-smb devstack@n-api.service[125531]: method: > Oct 19 00:41:47.689609 dv-cinder-master-3-smb devstack@n-api.service[125531]: exception: Cannot 'attach_volume' instance 4389c416-28bf-4b8e-945e-386f38c16859 while it is in vm_state rescued Oct 19 00:41:47.689609 dv-cinder-master-3-smb devstack@n-api.service[125531]: action_args: {'server_id': '4389c416-28bf-4b8e-945e-386f38c16859', 'body': {'volumeAttachment': {'volumeId': '707a5ab7-7166-457e-8700-cbbfc0a81a04'}}} Oct 19 00:41:47.689609 dv-cinder-master-3-smb devstack@n-api.service[125531]: {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:41:47.689609 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:41:47.689609 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 19 00:41:47.689609 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 19 00:41:47.689609 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 00:41:47.689609 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 00:41:47.689609 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 00:41:47.689609 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 00:41:47.689609 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4389c416-28bf-4b8e-945e-386f38c16859 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 19 00:41:47.689609 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:41:47.689609 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:41:47.689609 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:41:47.689609 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:41:47.689609 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:41:47.689609 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:41:47.689609 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:41:47.689609 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:41:47.690846 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:41:47.690846 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:41:47.690846 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:41:47.690846 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:41:47.690846 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:41:47.690846 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:41:47.690846 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:41:47.690846 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:41:47.690846 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 19 00:41:47.690846 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 00:41:47.690846 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 00:41:47.690846 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 00:41:47.690846 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 4389c416-28bf-4b8e-945e-386f38c16859 while it is in vm_state rescued Oct 19 00:41:47.690846 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:41:47.690846 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:41:47.690846 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:41:47.690846 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:41:47.690846 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:41:47.690846 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:41:47.692965 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:41:47.692965 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:41:47.692965 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 4389c416-28bf-4b8e-945e-386f38c16859 while it is in vm_state rescued Oct 19 00:41:47.692965 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:41:47.692965 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-5094cdb6-99ed-4f8c-ad6b-6ef0321f4e3d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Returning 409 to user: Cannot 'attach_volume' instance 4389c416-28bf-4b8e-945e-386f38c16859 while it is in vm_state rescued {{(pid=125531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:41:47.692965 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-5094cdb6-99ed-4f8c-ad6b-6ef0321f4e3d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "POST /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.050957 Oct 19 00:41:47.692965 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 149/333] 10.222.0.33 () {60 vars in 1323 bytes} [Wed Oct 19 00:41:47 2022] POST /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859/os-volume_attachments => generated 152 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 19 00:41:47.701105 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-38e6db29-cde2-4150-bec9-e20ffe0df807 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:41:47.701737 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-38e6db29-cde2-4150-bec9-e20ffe0df807 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4389c416-28bf-4b8e-945e-386f38c16859] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:47.706538 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-0db67c9a-5398-4486-87c4-487581fb88ca tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:47.708142 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-38e6db29-cde2-4150-bec9-e20ffe0df807 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:47.708633 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-38e6db29-cde2-4150-bec9-e20ffe0df807 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:47.709068 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-38e6db29-cde2-4150-bec9-e20ffe0df807 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:47.709802 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-38e6db29-cde2-4150-bec9-e20ffe0df807 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:47.710257 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-38e6db29-cde2-4150-bec9-e20ffe0df807 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:47.710793 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-38e6db29-cde2-4150-bec9-e20ffe0df807 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:47.714204 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-0db67c9a-5398-4486-87c4-487581fb88ca tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea" status: 200 len: 1271 microversion: 2.1 time: 0.240389 Oct 19 00:41:47.714776 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 185/334] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:47 2022] GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea => generated 1271 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:41:47.787317 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-38e6db29-cde2-4150-bec9-e20ffe0df807 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "POST /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859/action" status: 202 len: 0 microversion: 2.1 time: 0.090222 Oct 19 00:41:47.788503 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 150/335] 10.222.0.33 () {60 vars in 1278 bytes} [Wed Oct 19 00:41:47 2022] POST /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:41:47.798284 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-047deabf-30dd-43ae-abb5-309538805b1f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:47.799258 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-047deabf-30dd-43ae-abb5-309538805b1f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4389c416-28bf-4b8e-945e-386f38c16859] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:47.806590 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-047deabf-30dd-43ae-abb5-309538805b1f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:47.807569 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-047deabf-30dd-43ae-abb5-309538805b1f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:47.808371 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-047deabf-30dd-43ae-abb5-309538805b1f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:47.809399 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-047deabf-30dd-43ae-abb5-309538805b1f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:47.809944 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-047deabf-30dd-43ae-abb5-309538805b1f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:47.810725 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-047deabf-30dd-43ae-abb5-309538805b1f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:48.044623 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-047deabf-30dd-43ae-abb5-309538805b1f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:48.053260 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-047deabf-30dd-43ae-abb5-309538805b1f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859" status: 200 len: 1510 microversion: 2.1 time: 0.260326 Oct 19 00:41:48.054008 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 186/336] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:47 2022] GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859 => generated 1510 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:48.743675 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-e7210ae2-d6b9-4548-b0e6-9045b66f598b tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:48.746283 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-e7210ae2-d6b9-4548-b0e6-9045b66f598b tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 04a968fc-e77d-4848-b28e-98db63fb2eea] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:48.754393 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e7210ae2-d6b9-4548-b0e6-9045b66f598b tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:48.756158 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e7210ae2-d6b9-4548-b0e6-9045b66f598b tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:48.756821 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e7210ae2-d6b9-4548-b0e6-9045b66f598b tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:48.757990 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e7210ae2-d6b9-4548-b0e6-9045b66f598b tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:48.759303 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e7210ae2-d6b9-4548-b0e6-9045b66f598b tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:48.760002 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e7210ae2-d6b9-4548-b0e6-9045b66f598b tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:48.973456 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-e7210ae2-d6b9-4548-b0e6-9045b66f598b tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:48.981565 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-e7210ae2-d6b9-4548-b0e6-9045b66f598b tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea" status: 200 len: 1319 microversion: 2.1 time: 0.244469 Oct 19 00:41:48.982884 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 151/337] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:48 2022] GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:49.076656 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-469be9ce-b62b-47dc-bfc3-51d5788818f9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:49.077152 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-469be9ce-b62b-47dc-bfc3-51d5788818f9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4389c416-28bf-4b8e-945e-386f38c16859] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:49.083122 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-469be9ce-b62b-47dc-bfc3-51d5788818f9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:49.083603 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-469be9ce-b62b-47dc-bfc3-51d5788818f9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:49.084269 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-469be9ce-b62b-47dc-bfc3-51d5788818f9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:49.084978 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-469be9ce-b62b-47dc-bfc3-51d5788818f9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:49.085598 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-469be9ce-b62b-47dc-bfc3-51d5788818f9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:49.086022 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-469be9ce-b62b-47dc-bfc3-51d5788818f9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:49.275584 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-469be9ce-b62b-47dc-bfc3-51d5788818f9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:49.286156 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-469be9ce-b62b-47dc-bfc3-51d5788818f9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859" status: 200 len: 1510 microversion: 2.1 time: 0.213682 Oct 19 00:41:49.287054 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 187/338] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:49 2022] GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859 => generated 1510 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:49.445492 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-4aa6711b-5f21-43c6-ad84-70d87fe2a79a req-a578a6e7-3c8e-46fc-86c7-a840876fd534 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04a968fc-e77d-4848-b28e-98db63fb2eea", "tag": "29a45cb5-35ee-492e-aac3-5d7950d34482"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:41:49.455623 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-4aa6711b-5f21-43c6-ad84-70d87fe2a79a req-a578a6e7-3c8e-46fc-86c7-a840876fd534 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:49.456128 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-4aa6711b-5f21-43c6-ad84-70d87fe2a79a req-a578a6e7-3c8e-46fc-86c7-a840876fd534 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:49.456553 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-4aa6711b-5f21-43c6-ad84-70d87fe2a79a req-a578a6e7-3c8e-46fc-86c7-a840876fd534 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:49.467172 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-4aa6711b-5f21-43c6-ad84-70d87fe2a79a req-a578a6e7-3c8e-46fc-86c7-a840876fd534 service nova] Creating event network-changed:29a45cb5-35ee-492e-aac3-5d7950d34482 for instance 04a968fc-e77d-4848-b28e-98db63fb2eea on hv-cinder-maste Oct 19 00:41:49.472958 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-4aa6711b-5f21-43c6-ad84-70d87fe2a79a req-a578a6e7-3c8e-46fc-86c7-a840876fd534 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031218 Oct 19 00:41:49.473710 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 152/339] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:41:50.006478 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-497b1f8e-5a4c-4591-8f7a-af5805cef702 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:50.007241 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-497b1f8e-5a4c-4591-8f7a-af5805cef702 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 04a968fc-e77d-4848-b28e-98db63fb2eea] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:50.013067 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-497b1f8e-5a4c-4591-8f7a-af5805cef702 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:50.013543 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-497b1f8e-5a4c-4591-8f7a-af5805cef702 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:50.013968 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-497b1f8e-5a4c-4591-8f7a-af5805cef702 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:50.014720 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-497b1f8e-5a4c-4591-8f7a-af5805cef702 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:50.015675 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-497b1f8e-5a4c-4591-8f7a-af5805cef702 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:50.016123 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-497b1f8e-5a4c-4591-8f7a-af5805cef702 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:50.157224 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-497b1f8e-5a4c-4591-8f7a-af5805cef702 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:50.164818 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-497b1f8e-5a4c-4591-8f7a-af5805cef702 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea" status: 200 len: 1319 microversion: 2.1 time: 0.162253 Oct 19 00:41:50.165372 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 188/340] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:50 2022] GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:50.309872 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-32c90298-816c-43bb-9458-a85649159610 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:50.310558 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-32c90298-816c-43bb-9458-a85649159610 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4389c416-28bf-4b8e-945e-386f38c16859] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:50.316558 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-32c90298-816c-43bb-9458-a85649159610 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:50.317037 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-32c90298-816c-43bb-9458-a85649159610 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:50.317469 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-32c90298-816c-43bb-9458-a85649159610 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:50.318207 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-32c90298-816c-43bb-9458-a85649159610 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:50.318653 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-32c90298-816c-43bb-9458-a85649159610 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:50.319238 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-32c90298-816c-43bb-9458-a85649159610 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:50.455914 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-32c90298-816c-43bb-9458-a85649159610 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:50.466812 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-32c90298-816c-43bb-9458-a85649159610 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859" status: 200 len: 1510 microversion: 2.1 time: 0.159120 Oct 19 00:41:50.466812 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 153/341] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:50 2022] GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:51.188069 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-23d69f2f-00f7-439a-a25b-679c8d1008ee tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:51.188682 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-23d69f2f-00f7-439a-a25b-679c8d1008ee tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 04a968fc-e77d-4848-b28e-98db63fb2eea] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:51.194454 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-23d69f2f-00f7-439a-a25b-679c8d1008ee tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:51.194950 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-23d69f2f-00f7-439a-a25b-679c8d1008ee tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:51.195405 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-23d69f2f-00f7-439a-a25b-679c8d1008ee tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:51.196114 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-23d69f2f-00f7-439a-a25b-679c8d1008ee tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:51.196565 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-23d69f2f-00f7-439a-a25b-679c8d1008ee tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:51.196978 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-23d69f2f-00f7-439a-a25b-679c8d1008ee tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:51.332013 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-23d69f2f-00f7-439a-a25b-679c8d1008ee tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:51.340248 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-23d69f2f-00f7-439a-a25b-679c8d1008ee tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea" status: 200 len: 1319 microversion: 2.1 time: 0.156690 Oct 19 00:41:51.340813 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 189/342] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:51 2022] GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:51.488776 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-ad5a6677-f566-4965-9474-f26d78898da3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:51.489412 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-ad5a6677-f566-4965-9474-f26d78898da3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4389c416-28bf-4b8e-945e-386f38c16859] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:51.496671 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ad5a6677-f566-4965-9474-f26d78898da3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:51.497278 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ad5a6677-f566-4965-9474-f26d78898da3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:51.497841 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ad5a6677-f566-4965-9474-f26d78898da3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:51.498523 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ad5a6677-f566-4965-9474-f26d78898da3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:51.499076 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ad5a6677-f566-4965-9474-f26d78898da3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:51.500133 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ad5a6677-f566-4965-9474-f26d78898da3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:51.644975 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-ad5a6677-f566-4965-9474-f26d78898da3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:51.664531 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-ad5a6677-f566-4965-9474-f26d78898da3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859" status: 200 len: 1510 microversion: 2.1 time: 0.171925 Oct 19 00:41:51.670732 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 154/343] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:51 2022] GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859 => generated 1510 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:52.363680 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-36b18d3d-183f-4c13-820f-e09ecdc84f3a tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:52.364326 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-36b18d3d-183f-4c13-820f-e09ecdc84f3a tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 04a968fc-e77d-4848-b28e-98db63fb2eea] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:52.370547 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-36b18d3d-183f-4c13-820f-e09ecdc84f3a tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:52.371046 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-36b18d3d-183f-4c13-820f-e09ecdc84f3a tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:52.371530 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-36b18d3d-183f-4c13-820f-e09ecdc84f3a tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:52.372303 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-36b18d3d-183f-4c13-820f-e09ecdc84f3a tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:52.372757 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-36b18d3d-183f-4c13-820f-e09ecdc84f3a tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:52.373179 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-36b18d3d-183f-4c13-820f-e09ecdc84f3a tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:52.524223 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-36b18d3d-183f-4c13-820f-e09ecdc84f3a tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:52.535266 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-36b18d3d-183f-4c13-820f-e09ecdc84f3a tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea" status: 200 len: 1319 microversion: 2.1 time: 0.175558 Oct 19 00:41:52.535824 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 190/344] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:52 2022] GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:52.690845 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-62c2f66f-28e8-423a-8d5b-299bf87820ff tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:52.691487 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-62c2f66f-28e8-423a-8d5b-299bf87820ff tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4389c416-28bf-4b8e-945e-386f38c16859] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:52.697887 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-62c2f66f-28e8-423a-8d5b-299bf87820ff tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:52.698397 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-62c2f66f-28e8-423a-8d5b-299bf87820ff tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:52.698832 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-62c2f66f-28e8-423a-8d5b-299bf87820ff tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:52.699523 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-62c2f66f-28e8-423a-8d5b-299bf87820ff tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:52.700005 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-62c2f66f-28e8-423a-8d5b-299bf87820ff tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:52.700435 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-62c2f66f-28e8-423a-8d5b-299bf87820ff tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:52.833068 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-62c2f66f-28e8-423a-8d5b-299bf87820ff tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:52.840817 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-62c2f66f-28e8-423a-8d5b-299bf87820ff tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859" status: 200 len: 1516 microversion: 2.1 time: 0.154633 Oct 19 00:41:52.841369 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 155/345] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:52 2022] GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:53.559368 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-9c7b33f4-8a0f-4e69-850d-15adb3368091 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:53.560071 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-9c7b33f4-8a0f-4e69-850d-15adb3368091 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 04a968fc-e77d-4848-b28e-98db63fb2eea] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:53.568586 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9c7b33f4-8a0f-4e69-850d-15adb3368091 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:53.569069 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9c7b33f4-8a0f-4e69-850d-15adb3368091 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:53.569601 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9c7b33f4-8a0f-4e69-850d-15adb3368091 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:53.570174 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9c7b33f4-8a0f-4e69-850d-15adb3368091 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:53.570620 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9c7b33f4-8a0f-4e69-850d-15adb3368091 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:53.571037 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9c7b33f4-8a0f-4e69-850d-15adb3368091 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:53.705048 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-9c7b33f4-8a0f-4e69-850d-15adb3368091 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:53.713352 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-9c7b33f4-8a0f-4e69-850d-15adb3368091 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea" status: 200 len: 1319 microversion: 2.1 time: 0.157767 Oct 19 00:41:53.713905 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 191/346] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:53 2022] GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:54.232031 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-19f44cdd-5efa-4aaa-8cb3-d2298f5b3333 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Action: 'create', calling method: .version_select at 0x7f81f1286a60>, body: {"keypair": {"name": "tempest-keypair-1784206753", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAd5jmlcnuZbojliiR44CIf1wOCSyJOPp/RGFwuY0cQyRnxiArgxZy2tAVHEXbsaRkf/DRb0kcTfdn/3sw+nT5adLHsq4ArqeDWr/zNcL6Ka7NRqLOyLFkRUNrBZca1nkQ=="}} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:41:54.250341 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.quota [None req-19f44cdd-5efa-4aaa-8cb3-d2298f5b3333 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Getting quotas for project 5a230211180742ef9efd4d62b630d211. Resources: {'key_pairs'} {{(pid=125531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:41:54.254892 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.quota [None req-19f44cdd-5efa-4aaa-8cb3-d2298f5b3333 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Getting quotas for user 5628a861c90042d88b95f2d7b898ed52 and project 5a230211180742ef9efd4d62b630d211. Resources: {'key_pairs'} {{(pid=125531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:41:54.279919 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-19f44cdd-5efa-4aaa-8cb3-d2298f5b3333 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051877 Oct 19 00:41:54.287174 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 156/347] 10.222.0.33 () {60 vars in 1159 bytes} [Wed Oct 19 00:41:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:41:54.736978 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-00a2d49c-d154-4cc5-97e8-cbab6b19be09 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:54.737596 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-00a2d49c-d154-4cc5-97e8-cbab6b19be09 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 04a968fc-e77d-4848-b28e-98db63fb2eea] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:54.739758 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:54.746790 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-00a2d49c-d154-4cc5-97e8-cbab6b19be09 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:54.747512 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-00a2d49c-d154-4cc5-97e8-cbab6b19be09 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:54.748053 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-00a2d49c-d154-4cc5-97e8-cbab6b19be09 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:54.749265 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-00a2d49c-d154-4cc5-97e8-cbab6b19be09 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:54.749750 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-00a2d49c-d154-4cc5-97e8-cbab6b19be09 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:54.750342 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-00a2d49c-d154-4cc5-97e8-cbab6b19be09 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:54.896808 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-00a2d49c-d154-4cc5-97e8-cbab6b19be09 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:54.904440 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-00a2d49c-d154-4cc5-97e8-cbab6b19be09 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea" status: 200 len: 1319 microversion: 2.1 time: 0.171566 Oct 19 00:41:54.905841 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 192/348] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:54 2022] GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:55.615408 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-868eb5b7-2282-42f1-8123-68571d926ed9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-93082651", "imageRef": "d1f4abc9-3bb9-4343-9a05-53d758070c9d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ea4fbcd4-f89f-4128-8b67-a27e8fce8a1a"}], "security_groups": [{"name": "tempest-securitygroup--610355509"}], "key_name": "tempest-keypair-1784206753", "user_data": "}} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:41:55.720455 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.network.neutron [None req-868eb5b7-2282-42f1-8123-68571d926ed9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] validate_networks() for [('ea4fbcd4-f89f-4128-8b67-a27e8fce8a1a', None, None, None, None, None)] {{(pid=125531) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:41:55.929581 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-6dbce2f1-2eb2-4575-a25a-e3f9771f2699 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:55.930197 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-6dbce2f1-2eb2-4575-a25a-e3f9771f2699 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 04a968fc-e77d-4848-b28e-98db63fb2eea] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:55.937545 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6dbce2f1-2eb2-4575-a25a-e3f9771f2699 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:55.938032 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6dbce2f1-2eb2-4575-a25a-e3f9771f2699 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:55.938497 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6dbce2f1-2eb2-4575-a25a-e3f9771f2699 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:55.939187 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6dbce2f1-2eb2-4575-a25a-e3f9771f2699 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:55.939640 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6dbce2f1-2eb2-4575-a25a-e3f9771f2699 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:55.940085 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6dbce2f1-2eb2-4575-a25a-e3f9771f2699 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:56.082949 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-6dbce2f1-2eb2-4575-a25a-e3f9771f2699 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:56.091699 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-6dbce2f1-2eb2-4575-a25a-e3f9771f2699 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea" status: 200 len: 1319 microversion: 2.1 time: 0.166266 Oct 19 00:41:56.095901 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 193/349] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:55 2022] GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:56.133163 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-868eb5b7-2282-42f1-8123-68571d926ed9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Flavor limits 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:41:56.133582 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-868eb5b7-2282-42f1-8123-68571d926ed9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Image limits 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:41:56.134055 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-868eb5b7-2282-42f1-8123-68571d926ed9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Flavor pref 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:41:56.134458 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-868eb5b7-2282-42f1-8123-68571d926ed9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Image pref 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:41:56.134864 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-868eb5b7-2282-42f1-8123-68571d926ed9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:41:56.144306 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-868eb5b7-2282-42f1-8123-68571d926ed9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:56.144783 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-868eb5b7-2282-42f1-8123-68571d926ed9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:56.145211 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-868eb5b7-2282-42f1-8123-68571d926ed9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:56.145933 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-868eb5b7-2282-42f1-8123-68571d926ed9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:56.146384 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-868eb5b7-2282-42f1-8123-68571d926ed9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:56.146851 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-868eb5b7-2282-42f1-8123-68571d926ed9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:56.165244 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.quota [None req-868eb5b7-2282-42f1-8123-68571d926ed9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Getting quotas for project 5a230211180742ef9efd4d62b630d211. Resources: {'instances', 'cores', 'ram'} {{(pid=125531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:41:56.169460 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.quota [None req-868eb5b7-2282-42f1-8123-68571d926ed9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Getting quotas for user 5628a861c90042d88b95f2d7b898ed52 and project 5a230211180742ef9efd4d62b630d211. Resources: {'instances', 'cores', 'ram'} {{(pid=125531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:41:56.183659 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-868eb5b7-2282-42f1-8123-68571d926ed9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Going to run 1 instances... {{(pid=125531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:41:56.186013 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-868eb5b7-2282-42f1-8123-68571d926ed9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1f4abc9-3bb9-4343-9a05-53d758070c9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:41:56.236532 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-868eb5b7-2282-42f1-8123-68571d926ed9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.625303 Oct 19 00:41:56.241915 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 157/350] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Oct 19 00:41:55 2022] POST /compute/v2.1/servers => generated 408 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:41:56.248511 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-745ce84a-c4e0-46c4-88cb-b3be8525198d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:56.249158 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-745ce84a-c4e0-46c4-88cb-b3be8525198d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:56.300123 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell0:SELECT=2 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:56.305794 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-745ce84a-c4e0-46c4-88cb-b3be8525198d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:56.314326 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-745ce84a-c4e0-46c4-88cb-b3be8525198d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1244 microversion: 2.1 time: 0.069734 Oct 19 00:41:56.314901 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 194/351] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:56 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1244 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:57.115622 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-e5e31d7e-c835-4a21-bb6f-d4d4f7c70847 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:57.116331 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-e5e31d7e-c835-4a21-bb6f-d4d4f7c70847 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 04a968fc-e77d-4848-b28e-98db63fb2eea] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:57.122381 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e5e31d7e-c835-4a21-bb6f-d4d4f7c70847 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:57.123072 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e5e31d7e-c835-4a21-bb6f-d4d4f7c70847 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:57.123629 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e5e31d7e-c835-4a21-bb6f-d4d4f7c70847 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:57.124442 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e5e31d7e-c835-4a21-bb6f-d4d4f7c70847 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:57.124960 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e5e31d7e-c835-4a21-bb6f-d4d4f7c70847 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:57.125602 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e5e31d7e-c835-4a21-bb6f-d4d4f7c70847 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:57.255894 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-e5e31d7e-c835-4a21-bb6f-d4d4f7c70847 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:57.263506 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-e5e31d7e-c835-4a21-bb6f-d4d4f7c70847 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea" status: 200 len: 1319 microversion: 2.1 time: 0.152585 Oct 19 00:41:57.264088 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 158/352] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:57 2022] GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:57.337966 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-32e8e6ee-5dbe-44f5-9623-bbe7b9bf0067 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:57.338578 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-32e8e6ee-5dbe-44f5-9623-bbe7b9bf0067 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:57.344632 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-32e8e6ee-5dbe-44f5-9623-bbe7b9bf0067 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:57.345141 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-32e8e6ee-5dbe-44f5-9623-bbe7b9bf0067 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:57.345851 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-32e8e6ee-5dbe-44f5-9623-bbe7b9bf0067 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:57.346544 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-32e8e6ee-5dbe-44f5-9623-bbe7b9bf0067 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:57.346994 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-32e8e6ee-5dbe-44f5-9623-bbe7b9bf0067 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:57.347414 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-32e8e6ee-5dbe-44f5-9623-bbe7b9bf0067 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:57.351397 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell1:SELECT=100 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:57.410100 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-32e8e6ee-5dbe-44f5-9623-bbe7b9bf0067 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:57.417603 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-32e8e6ee-5dbe-44f5-9623-bbe7b9bf0067 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1296 microversion: 2.1 time: 0.083677 Oct 19 00:41:57.418147 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 195/353] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:57 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1296 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:58.179895 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-fdac29d4-e51e-4deb-bde5-bca93e9d9bf9 req-e464288e-cbc0-416d-8843-0a2b84d9b144 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04a968fc-e77d-4848-b28e-98db63fb2eea", "name": "network-vif-plugged", "status": "completed", "tag": "29a45cb5-35ee-492e-aac3-5d7950d34482"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:41:58.192045 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-fdac29d4-e51e-4deb-bde5-bca93e9d9bf9 req-e464288e-cbc0-416d-8843-0a2b84d9b144 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:58.193545 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-fdac29d4-e51e-4deb-bde5-bca93e9d9bf9 req-e464288e-cbc0-416d-8843-0a2b84d9b144 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:58.194349 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-fdac29d4-e51e-4deb-bde5-bca93e9d9bf9 req-e464288e-cbc0-416d-8843-0a2b84d9b144 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:58.209474 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-fdac29d4-e51e-4deb-bde5-bca93e9d9bf9 req-e464288e-cbc0-416d-8843-0a2b84d9b144 service nova] Creating event network-vif-plugged:29a45cb5-35ee-492e-aac3-5d7950d34482 for instance 04a968fc-e77d-4848-b28e-98db63fb2eea on hv-cinder-maste Oct 19 00:41:58.215094 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-fdac29d4-e51e-4deb-bde5-bca93e9d9bf9 req-e464288e-cbc0-416d-8843-0a2b84d9b144 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041728 Oct 19 00:41:58.215977 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 159/354] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:41:58.287002 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-ac8e8d61-496e-4f9c-ae15-34270999edea tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:58.287699 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-ac8e8d61-496e-4f9c-ae15-34270999edea tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 04a968fc-e77d-4848-b28e-98db63fb2eea] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:58.294520 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ac8e8d61-496e-4f9c-ae15-34270999edea tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:58.295106 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ac8e8d61-496e-4f9c-ae15-34270999edea tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:58.295611 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ac8e8d61-496e-4f9c-ae15-34270999edea tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:58.296904 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ac8e8d61-496e-4f9c-ae15-34270999edea tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:58.303400 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ac8e8d61-496e-4f9c-ae15-34270999edea tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:58.304272 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ac8e8d61-496e-4f9c-ae15-34270999edea tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:58.442689 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-dc835d89-7515-4007-80b7-c33ebabafe23 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:58.444048 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-dc835d89-7515-4007-80b7-c33ebabafe23 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:58.451820 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dc835d89-7515-4007-80b7-c33ebabafe23 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:58.452282 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dc835d89-7515-4007-80b7-c33ebabafe23 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:58.453120 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dc835d89-7515-4007-80b7-c33ebabafe23 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:58.453868 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dc835d89-7515-4007-80b7-c33ebabafe23 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:58.455007 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dc835d89-7515-4007-80b7-c33ebabafe23 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:58.456003 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dc835d89-7515-4007-80b7-c33ebabafe23 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:58.519131 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-ac8e8d61-496e-4f9c-ae15-34270999edea tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:58.527913 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-ac8e8d61-496e-4f9c-ae15-34270999edea tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea" status: 200 len: 1319 microversion: 2.1 time: 0.245445 Oct 19 00:41:58.528577 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 196/355] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:58 2022] GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:58.731051 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-dc835d89-7515-4007-80b7-c33ebabafe23 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:58.740539 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-dc835d89-7515-4007-80b7-c33ebabafe23 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1369 microversion: 2.1 time: 0.303407 Oct 19 00:41:58.741372 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 160/356] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:58 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1369 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:41:59.554168 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-817a014e-1be2-4f41-a223-4ec7744e9cba tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:59.554685 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-817a014e-1be2-4f41-a223-4ec7744e9cba tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 04a968fc-e77d-4848-b28e-98db63fb2eea] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:59.560550 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-817a014e-1be2-4f41-a223-4ec7744e9cba tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:59.561026 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-817a014e-1be2-4f41-a223-4ec7744e9cba tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:59.561460 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-817a014e-1be2-4f41-a223-4ec7744e9cba tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:59.562143 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-817a014e-1be2-4f41-a223-4ec7744e9cba tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:59.562617 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-817a014e-1be2-4f41-a223-4ec7744e9cba tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:59.563038 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-817a014e-1be2-4f41-a223-4ec7744e9cba tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:59.597128 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-aeca2541-a8c9-453a-abfb-2df048720da5 req-4d5bb799-fb75-4e4a-9af1-89a0cf0040dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b862704-38e5-4ea8-9fa2-741591535b6f", "tag": "1d63aec2-4f59-4c65-8d08-0a5e740a5e12"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:41:59.608205 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-aeca2541-a8c9-453a-abfb-2df048720da5 req-4d5bb799-fb75-4e4a-9af1-89a0cf0040dc service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:59.609073 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-aeca2541-a8c9-453a-abfb-2df048720da5 req-4d5bb799-fb75-4e4a-9af1-89a0cf0040dc service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:59.609632 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-aeca2541-a8c9-453a-abfb-2df048720da5 req-4d5bb799-fb75-4e4a-9af1-89a0cf0040dc service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:59.622358 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-aeca2541-a8c9-453a-abfb-2df048720da5 req-4d5bb799-fb75-4e4a-9af1-89a0cf0040dc service nova] Creating event network-changed:1d63aec2-4f59-4c65-8d08-0a5e740a5e12 for instance 4b862704-38e5-4ea8-9fa2-741591535b6f on hv-cinder-maste Oct 19 00:41:59.629589 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-aeca2541-a8c9-453a-abfb-2df048720da5 req-4d5bb799-fb75-4e4a-9af1-89a0cf0040dc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036228 Oct 19 00:41:59.630762 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 161/357] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:41:59.713945 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-817a014e-1be2-4f41-a223-4ec7744e9cba tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:41:59.721598 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-817a014e-1be2-4f41-a223-4ec7744e9cba tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea" status: 200 len: 1319 microversion: 2.1 time: 0.171331 Oct 19 00:41:59.722161 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 197/358] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:59 2022] GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:59.766490 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-fdb24542-1567-490c-bcfa-0c9eced64f7b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:59.767903 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-fdb24542-1567-490c-bcfa-0c9eced64f7b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:41:59.774182 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fdb24542-1567-490c-bcfa-0c9eced64f7b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:59.774741 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fdb24542-1567-490c-bcfa-0c9eced64f7b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:59.775251 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fdb24542-1567-490c-bcfa-0c9eced64f7b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:59.776113 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fdb24542-1567-490c-bcfa-0c9eced64f7b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:59.776648 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fdb24542-1567-490c-bcfa-0c9eced64f7b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:59.777143 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fdb24542-1567-490c-bcfa-0c9eced64f7b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:00.046128 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-fdb24542-1567-490c-bcfa-0c9eced64f7b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:00.055523 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-fdb24542-1567-490c-bcfa-0c9eced64f7b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1369 microversion: 2.1 time: 0.293418 Oct 19 00:42:00.056138 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 162/359] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:41:59 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1369 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:00.745029 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-eba59225-f5b5-44d3-8398-8fbc88da297f tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:00.745654 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-eba59225-f5b5-44d3-8398-8fbc88da297f tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 04a968fc-e77d-4848-b28e-98db63fb2eea] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:00.752423 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-eba59225-f5b5-44d3-8398-8fbc88da297f tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:00.752913 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-eba59225-f5b5-44d3-8398-8fbc88da297f tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:00.753350 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-eba59225-f5b5-44d3-8398-8fbc88da297f tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:00.754052 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-eba59225-f5b5-44d3-8398-8fbc88da297f tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:00.754503 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-eba59225-f5b5-44d3-8398-8fbc88da297f tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:00.754925 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-eba59225-f5b5-44d3-8398-8fbc88da297f tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:00.893683 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-eba59225-f5b5-44d3-8398-8fbc88da297f tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:00.902145 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-eba59225-f5b5-44d3-8398-8fbc88da297f tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea" status: 200 len: 1508 microversion: 2.1 time: 0.160785 Oct 19 00:42:00.902774 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 198/360] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:00 2022] GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:01.080418 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-3d22ce11-dffa-4145-b19a-62191b7aa915 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:01.081033 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-3d22ce11-dffa-4145-b19a-62191b7aa915 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:01.098501 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3d22ce11-dffa-4145-b19a-62191b7aa915 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:01.099001 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3d22ce11-dffa-4145-b19a-62191b7aa915 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:01.103688 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3d22ce11-dffa-4145-b19a-62191b7aa915 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:01.104517 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3d22ce11-dffa-4145-b19a-62191b7aa915 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:01.104988 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3d22ce11-dffa-4145-b19a-62191b7aa915 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:01.105442 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3d22ce11-dffa-4145-b19a-62191b7aa915 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:01.258809 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-3d22ce11-dffa-4145-b19a-62191b7aa915 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:01.267456 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-3d22ce11-dffa-4145-b19a-62191b7aa915 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1369 microversion: 2.1 time: 0.192319 Oct 19 00:42:01.268275 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 163/361] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:01 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1369 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:02.289430 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-89dc5b36-c1d0-4d33-ba09-0674493c49a6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:02.290046 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-89dc5b36-c1d0-4d33-ba09-0674493c49a6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:02.296012 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-89dc5b36-c1d0-4d33-ba09-0674493c49a6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:02.296498 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-89dc5b36-c1d0-4d33-ba09-0674493c49a6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:02.296935 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-89dc5b36-c1d0-4d33-ba09-0674493c49a6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:02.297634 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-89dc5b36-c1d0-4d33-ba09-0674493c49a6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:02.298090 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-89dc5b36-c1d0-4d33-ba09-0674493c49a6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:02.299006 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-89dc5b36-c1d0-4d33-ba09-0674493c49a6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:02.441992 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-89dc5b36-c1d0-4d33-ba09-0674493c49a6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:02.454199 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-89dc5b36-c1d0-4d33-ba09-0674493c49a6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1369 microversion: 2.1 time: 0.168275 Oct 19 00:42:02.475918 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 199/362] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:02 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1369 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:03.479468 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-309f2b79-acd4-47b0-bc44-8e77715c877c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:03.480204 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-309f2b79-acd4-47b0-bc44-8e77715c877c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:03.483445 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:03.490107 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-309f2b79-acd4-47b0-bc44-8e77715c877c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:03.490683 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-309f2b79-acd4-47b0-bc44-8e77715c877c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:03.491219 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-309f2b79-acd4-47b0-bc44-8e77715c877c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:03.492094 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-309f2b79-acd4-47b0-bc44-8e77715c877c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:03.492628 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-309f2b79-acd4-47b0-bc44-8e77715c877c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:03.493060 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-309f2b79-acd4-47b0-bc44-8e77715c877c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:03.638901 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-309f2b79-acd4-47b0-bc44-8e77715c877c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:03.647420 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-309f2b79-acd4-47b0-bc44-8e77715c877c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1369 microversion: 2.1 time: 0.172063 Oct 19 00:42:03.648009 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 164/363] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:03 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1369 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:42:04.670332 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-94405003-4c37-4add-80fe-e5317afd9a86 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:04.670945 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-94405003-4c37-4add-80fe-e5317afd9a86 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:04.677161 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-94405003-4c37-4add-80fe-e5317afd9a86 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:04.677640 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-94405003-4c37-4add-80fe-e5317afd9a86 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:04.678076 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-94405003-4c37-4add-80fe-e5317afd9a86 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:04.678765 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-94405003-4c37-4add-80fe-e5317afd9a86 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:04.679224 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-94405003-4c37-4add-80fe-e5317afd9a86 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:04.679646 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-94405003-4c37-4add-80fe-e5317afd9a86 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:04.812419 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-94405003-4c37-4add-80fe-e5317afd9a86 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:04.820525 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-94405003-4c37-4add-80fe-e5317afd9a86 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1369 microversion: 2.1 time: 0.154094 Oct 19 00:42:04.821083 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 200/364] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:04 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:05.844496 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-9da8ef71-c7bc-4cbd-960f-e719fca3f3c4 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:05.845349 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-9da8ef71-c7bc-4cbd-960f-e719fca3f3c4 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:05.852517 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9da8ef71-c7bc-4cbd-960f-e719fca3f3c4 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:05.853001 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9da8ef71-c7bc-4cbd-960f-e719fca3f3c4 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:05.853463 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9da8ef71-c7bc-4cbd-960f-e719fca3f3c4 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:05.854161 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9da8ef71-c7bc-4cbd-960f-e719fca3f3c4 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:05.854621 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9da8ef71-c7bc-4cbd-960f-e719fca3f3c4 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:05.855045 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9da8ef71-c7bc-4cbd-960f-e719fca3f3c4 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:05.985054 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-9da8ef71-c7bc-4cbd-960f-e719fca3f3c4 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:05.993180 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-9da8ef71-c7bc-4cbd-960f-e719fca3f3c4 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1369 microversion: 2.1 time: 0.152475 Oct 19 00:42:05.993744 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 165/365] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:05 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1369 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:07.016849 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-c22a946a-93c0-48cc-9388-3ed833fc895d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:07.017519 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-c22a946a-93c0-48cc-9388-3ed833fc895d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:07.019460 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell0:SELECT=10 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:07.024780 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c22a946a-93c0-48cc-9388-3ed833fc895d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:07.025263 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c22a946a-93c0-48cc-9388-3ed833fc895d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:07.025699 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c22a946a-93c0-48cc-9388-3ed833fc895d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:07.026393 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c22a946a-93c0-48cc-9388-3ed833fc895d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:07.026853 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c22a946a-93c0-48cc-9388-3ed833fc895d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:07.027283 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c22a946a-93c0-48cc-9388-3ed833fc895d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:07.162777 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-c22a946a-93c0-48cc-9388-3ed833fc895d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:07.176126 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-c22a946a-93c0-48cc-9388-3ed833fc895d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1369 microversion: 2.1 time: 0.161836 Oct 19 00:42:07.177004 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 201/366] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:07 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1369 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:08.202018 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-d552d1bb-8b8b-4f66-8e76-61dde950d917 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:08.207141 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-d552d1bb-8b8b-4f66-8e76-61dde950d917 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:08.209323 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell0:SELECT=2 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:08.210717 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell0:SELECT=10 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:08.216785 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d552d1bb-8b8b-4f66-8e76-61dde950d917 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:08.217280 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d552d1bb-8b8b-4f66-8e76-61dde950d917 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:08.217721 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d552d1bb-8b8b-4f66-8e76-61dde950d917 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:08.218587 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d552d1bb-8b8b-4f66-8e76-61dde950d917 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:08.219047 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d552d1bb-8b8b-4f66-8e76-61dde950d917 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:08.219475 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d552d1bb-8b8b-4f66-8e76-61dde950d917 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:08.390644 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-d552d1bb-8b8b-4f66-8e76-61dde950d917 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:08.397394 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:08.398146 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-9b9166c8-f688-49d8-bc21-bcad93fb0645 req-43a0ea0a-b6db-4597-b755-4a455293a7a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b862704-38e5-4ea8-9fa2-741591535b6f", "name": "network-vif-plugged", "status": "completed", "tag": "1d63aec2-4f59-4c65-8d08-0a5e740a5e12"}]} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:42:08.414309 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-d552d1bb-8b8b-4f66-8e76-61dde950d917 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1369 microversion: 2.1 time: 0.216398 Oct 19 00:42:08.415709 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 166/367] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:08 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1369 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:08.417579 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-9b9166c8-f688-49d8-bc21-bcad93fb0645 req-43a0ea0a-b6db-4597-b755-4a455293a7a0 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:08.418061 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-9b9166c8-f688-49d8-bc21-bcad93fb0645 req-43a0ea0a-b6db-4597-b755-4a455293a7a0 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:08.418492 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-9b9166c8-f688-49d8-bc21-bcad93fb0645 req-43a0ea0a-b6db-4597-b755-4a455293a7a0 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:08.439035 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.compute.server_external_events [req-9b9166c8-f688-49d8-bc21-bcad93fb0645 req-43a0ea0a-b6db-4597-b755-4a455293a7a0 service nova] Creating event network-vif-plugged:1d63aec2-4f59-4c65-8d08-0a5e740a5e12 for instance 4b862704-38e5-4ea8-9fa2-741591535b6f on hv-cinder-maste Oct 19 00:42:08.447263 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-9b9166c8-f688-49d8-bc21-bcad93fb0645 req-43a0ea0a-b6db-4597-b755-4a455293a7a0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058546 Oct 19 00:42:08.448079 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 202/368] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:42:09.438037 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-c5500987-54fb-4eeb-9339-b786dff77e8d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:09.438785 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-c5500987-54fb-4eeb-9339-b786dff77e8d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:09.447085 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c5500987-54fb-4eeb-9339-b786dff77e8d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:09.447564 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c5500987-54fb-4eeb-9339-b786dff77e8d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:09.448023 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c5500987-54fb-4eeb-9339-b786dff77e8d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:09.448739 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c5500987-54fb-4eeb-9339-b786dff77e8d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:09.449184 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c5500987-54fb-4eeb-9339-b786dff77e8d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:09.449601 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c5500987-54fb-4eeb-9339-b786dff77e8d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:09.579677 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-c5500987-54fb-4eeb-9339-b786dff77e8d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:09.589045 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-c5500987-54fb-4eeb-9339-b786dff77e8d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1369 microversion: 2.1 time: 0.155090 Oct 19 00:42:09.595170 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 167/369] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:09 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1369 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:10.613229 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-4f8b4138-7aa0-4117-bb4d-4c0068a6ab0f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:10.615573 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-4f8b4138-7aa0-4117-bb4d-4c0068a6ab0f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:10.622675 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4f8b4138-7aa0-4117-bb4d-4c0068a6ab0f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:10.623427 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4f8b4138-7aa0-4117-bb4d-4c0068a6ab0f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:10.623901 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4f8b4138-7aa0-4117-bb4d-4c0068a6ab0f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:10.624674 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4f8b4138-7aa0-4117-bb4d-4c0068a6ab0f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:10.625657 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4f8b4138-7aa0-4117-bb4d-4c0068a6ab0f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:10.625657 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4f8b4138-7aa0-4117-bb4d-4c0068a6ab0f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:10.772758 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-4f8b4138-7aa0-4117-bb4d-4c0068a6ab0f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:10.780547 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-4f8b4138-7aa0-4117-bb4d-4c0068a6ab0f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1369 microversion: 2.1 time: 0.172518 Oct 19 00:42:10.781076 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 203/370] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:10 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1369 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:11.803108 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-36253473-9c33-41a5-80bf-8e14e3fb1a2b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:11.803783 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-36253473-9c33-41a5-80bf-8e14e3fb1a2b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:11.810282 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-36253473-9c33-41a5-80bf-8e14e3fb1a2b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:11.810766 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-36253473-9c33-41a5-80bf-8e14e3fb1a2b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:11.811257 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-36253473-9c33-41a5-80bf-8e14e3fb1a2b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:11.811995 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-36253473-9c33-41a5-80bf-8e14e3fb1a2b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:11.812450 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-36253473-9c33-41a5-80bf-8e14e3fb1a2b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:11.812871 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-36253473-9c33-41a5-80bf-8e14e3fb1a2b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:11.945629 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-36253473-9c33-41a5-80bf-8e14e3fb1a2b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:11.953398 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-36253473-9c33-41a5-80bf-8e14e3fb1a2b tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1564 microversion: 2.1 time: 0.154757 Oct 19 00:42:11.953974 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 168/371] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:11 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:11.977638 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-d0d6945d-40f1-4b90-8aeb-e752af4724e1 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:11.978127 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-d0d6945d-40f1-4b90-8aeb-e752af4724e1 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:11.984027 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d0d6945d-40f1-4b90-8aeb-e752af4724e1 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:11.984505 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d0d6945d-40f1-4b90-8aeb-e752af4724e1 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:11.984936 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d0d6945d-40f1-4b90-8aeb-e752af4724e1 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:11.985621 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d0d6945d-40f1-4b90-8aeb-e752af4724e1 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:11.986070 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d0d6945d-40f1-4b90-8aeb-e752af4724e1 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:11.986740 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d0d6945d-40f1-4b90-8aeb-e752af4724e1 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:12.066235 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-d0d6945d-40f1-4b90-8aeb-e752af4724e1 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093159 Oct 19 00:42:12.066831 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 204/372] 10.222.0.33 () {58 vars in 1275 bytes} [Wed Oct 19 00:42:11 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:42:13.267308 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-3d239e04-23c4-4b08-a6c0-a925f065ba1e req-e8641cf7-dbfe-4887-a027-2b890d937b13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b862704-38e5-4ea8-9fa2-741591535b6f", "tag": "1d63aec2-4f59-4c65-8d08-0a5e740a5e12"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:42:13.278202 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-3d239e04-23c4-4b08-a6c0-a925f065ba1e req-e8641cf7-dbfe-4887-a027-2b890d937b13 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:13.278785 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-3d239e04-23c4-4b08-a6c0-a925f065ba1e req-e8641cf7-dbfe-4887-a027-2b890d937b13 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:13.279290 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-3d239e04-23c4-4b08-a6c0-a925f065ba1e req-e8641cf7-dbfe-4887-a027-2b890d937b13 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:13.291362 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-3d239e04-23c4-4b08-a6c0-a925f065ba1e req-e8641cf7-dbfe-4887-a027-2b890d937b13 service nova] Creating event network-changed:1d63aec2-4f59-4c65-8d08-0a5e740a5e12 for instance 4b862704-38e5-4ea8-9fa2-741591535b6f on hv-cinder-maste Oct 19 00:42:13.297424 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-3d239e04-23c4-4b08-a6c0-a925f065ba1e req-e8641cf7-dbfe-4887-a027-2b890d937b13 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033577 Oct 19 00:42:13.298281 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 169/373] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:42:21.898850 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-8c723e51-6369-41af-a8a9-0c4cbe152029 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:21.899449 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-8c723e51-6369-41af-a8a9-0c4cbe152029 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:21.907090 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8c723e51-6369-41af-a8a9-0c4cbe152029 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:21.907685 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8c723e51-6369-41af-a8a9-0c4cbe152029 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:21.908217 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8c723e51-6369-41af-a8a9-0c4cbe152029 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:21.908993 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8c723e51-6369-41af-a8a9-0c4cbe152029 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:21.909524 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8c723e51-6369-41af-a8a9-0c4cbe152029 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:21.910023 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8c723e51-6369-41af-a8a9-0c4cbe152029 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:21.935506 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-8c723e51-6369-41af-a8a9-0c4cbe152029 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2/ips" status: 200 len: 150 microversion: 2.20 time: 0.041817 Oct 19 00:42:21.947115 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 205/374] 10.222.0.33 () {60 vars in 1289 bytes} [Wed Oct 19 00:42:21 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:42:22.901009 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-4de816c6-c5d4-43aa-82e2-22d5efb54e28 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:22.901563 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-4de816c6-c5d4-43aa-82e2-22d5efb54e28 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 361dfd3b-f488-4dac-9511-f28c93f74d37] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:22.909979 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4de816c6-c5d4-43aa-82e2-22d5efb54e28 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:22.910927 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4de816c6-c5d4-43aa-82e2-22d5efb54e28 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:22.911741 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4de816c6-c5d4-43aa-82e2-22d5efb54e28 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:22.914235 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4de816c6-c5d4-43aa-82e2-22d5efb54e28 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:22.914841 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4de816c6-c5d4-43aa-82e2-22d5efb54e28 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:22.915409 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4de816c6-c5d4-43aa-82e2-22d5efb54e28 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:22.943080 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-4de816c6-c5d4-43aa-82e2-22d5efb54e28 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37/ips" status: 200 len: 148 microversion: 2.1 time: 0.047950 Oct 19 00:42:22.944744 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 170/375] 10.222.0.33 () {58 vars in 1248 bytes} [Wed Oct 19 00:42:22 2022] GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37/ips => generated 148 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:42:23.737721 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-557f0a5b-67df-4a15-8137-cda9ee0a0ecb tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df3dcba1-7afd-4b49-a531-a0af55908ad8", "device": "/dev/sdb"}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:42:23.740836 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-557f0a5b-67df-4a15-8137-cda9ee0a0ecb tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 04a968fc-e77d-4848-b28e-98db63fb2eea] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:23.746930 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-557f0a5b-67df-4a15-8137-cda9ee0a0ecb tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:23.747420 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-557f0a5b-67df-4a15-8137-cda9ee0a0ecb tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:23.747873 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-557f0a5b-67df-4a15-8137-cda9ee0a0ecb tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:23.748651 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-557f0a5b-67df-4a15-8137-cda9ee0a0ecb tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:23.749117 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-557f0a5b-67df-4a15-8137-cda9ee0a0ecb tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:23.749533 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-557f0a5b-67df-4a15-8137-cda9ee0a0ecb tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:24.136139 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-557f0a5b-67df-4a15-8137-cda9ee0a0ecb tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "POST /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.402786 Oct 19 00:42:24.137109 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 206/376] 10.222.0.33 () {60 vars in 1323 bytes} [Wed Oct 19 00:42:23 2022] POST /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea/os-volume_attachments => generated 194 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:42:24.493693 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-09f815f6-a209-4ab2-88ef-66917320e7b6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b6f31ef-f34a-485e-833c-6f3371a1800b"}} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:42:24.496097 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-09f815f6-a209-4ab2-88ef-66917320e7b6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 361dfd3b-f488-4dac-9511-f28c93f74d37] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:24.502903 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-09f815f6-a209-4ab2-88ef-66917320e7b6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:24.503384 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-09f815f6-a209-4ab2-88ef-66917320e7b6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:24.504548 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-09f815f6-a209-4ab2-88ef-66917320e7b6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:24.505698 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-09f815f6-a209-4ab2-88ef-66917320e7b6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:24.506975 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-09f815f6-a209-4ab2-88ef-66917320e7b6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:24.507559 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-09f815f6-a209-4ab2-88ef-66917320e7b6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:25.193057 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-40cf8e29-0f55-424b-ac95-1492af5fc72b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:42:25.194082 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-40cf8e29-0f55-424b-ac95-1492af5fc72b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:25.197167 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_api:SELECT=32 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:25.202900 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-40cf8e29-0f55-424b-ac95-1492af5fc72b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:25.203819 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-40cf8e29-0f55-424b-ac95-1492af5fc72b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:25.204457 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-40cf8e29-0f55-424b-ac95-1492af5fc72b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:25.205175 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-40cf8e29-0f55-424b-ac95-1492af5fc72b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:25.205701 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-40cf8e29-0f55-424b-ac95-1492af5fc72b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:25.206338 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-40cf8e29-0f55-424b-ac95-1492af5fc72b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:25.232885 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.objects.instance [None req-40cf8e29-0f55-424b-ac95-1492af5fc72b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lazy-loading 'flavor' on Instance uuid 1c74fb45-ef8a-4a88-8126-21c8266fddb2 {{(pid=125532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:42:25.606836 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-40cf8e29-0f55-424b-ac95-1492af5fc72b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "POST /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2/action" status: 202 len: 0 microversion: 2.20 time: 0.417477 Oct 19 00:42:25.629641 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 207/377] 10.222.0.33 () {62 vars in 1319 bytes} [Wed Oct 19 00:42:25 2022] POST /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2/action => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:42:25.638488 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-8bd1529d-ca2b-4555-be16-6a5cba271180 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:25.639204 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-8bd1529d-ca2b-4555-be16-6a5cba271180 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:25.646572 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8bd1529d-ca2b-4555-be16-6a5cba271180 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:25.647631 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8bd1529d-ca2b-4555-be16-6a5cba271180 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:25.648758 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8bd1529d-ca2b-4555-be16-6a5cba271180 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:25.650542 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8bd1529d-ca2b-4555-be16-6a5cba271180 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:25.652491 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8bd1529d-ca2b-4555-be16-6a5cba271180 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:25.653093 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8bd1529d-ca2b-4555-be16-6a5cba271180 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:25.660332 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-09f815f6-a209-4ab2-88ef-66917320e7b6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "POST /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.171651 Oct 19 00:42:25.668197 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 171/378] 10.222.0.33 () {60 vars in 1323 bytes} [Wed Oct 19 00:42:24 2022] POST /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37/os-volume_attachments => generated 194 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:42:25.966180 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-8bd1529d-ca2b-4555-be16-6a5cba271180 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:25.979605 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-8bd1529d-ca2b-4555-be16-6a5cba271180 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:25.981360 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-8bd1529d-ca2b-4555-be16-6a5cba271180 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:25.983053 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-8bd1529d-ca2b-4555-be16-6a5cba271180 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1722 microversion: 2.20 time: 0.350001 Oct 19 00:42:25.983720 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 208/379] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:42:25 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1722 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:42:27.012586 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-345a992c-4bf8-4734-bce6-c51924fb158a tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:27.013376 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-345a992c-4bf8-4734-bce6-c51924fb158a tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:27.020247 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-345a992c-4bf8-4734-bce6-c51924fb158a tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:27.020841 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-345a992c-4bf8-4734-bce6-c51924fb158a tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:27.021181 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-345a992c-4bf8-4734-bce6-c51924fb158a tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:27.022226 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-345a992c-4bf8-4734-bce6-c51924fb158a tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:27.029224 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-345a992c-4bf8-4734-bce6-c51924fb158a tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:27.030074 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-345a992c-4bf8-4734-bce6-c51924fb158a tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:27.234809 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-345a992c-4bf8-4734-bce6-c51924fb158a tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:27.244637 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-345a992c-4bf8-4734-bce6-c51924fb158a tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:27.246729 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-345a992c-4bf8-4734-bce6-c51924fb158a tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:27.248402 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-345a992c-4bf8-4734-bce6-c51924fb158a tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1722 microversion: 2.20 time: 0.241325 Oct 19 00:42:27.249347 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 172/380] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:42:27 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:42:27.767555 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-dd7e2e0b-73a6-4039-990f-cf346eea213b req-33d28fe2-301f-4b61-918f-aafbae57ebf6 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "df3dcba1-7afd-4b49-a531-a0af55908ad8", "create_info": {"type": "qcow2", "new_file": "volume-df3dcba1-7afd-4b49-a531-a0af55908ad8.fd331631-0d94-412c-9be2-3465f598aa3a.vhdx", "snapshot_id": "fd331631-0d94-412c-9be2-3465f598aa3a"}}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:42:27.787399 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [req-dd7e2e0b-73a6-4039-990f-cf346eea213b req-33d28fe2-301f-4b61-918f-aafbae57ebf6 admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab(cell1) {{(pid=125532) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 19 00:42:27.787926 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-dd7e2e0b-73a6-4039-990f-cf346eea213b req-33d28fe2-301f-4b61-918f-aafbae57ebf6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:27.788678 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-dd7e2e0b-73a6-4039-990f-cf346eea213b req-33d28fe2-301f-4b61-918f-aafbae57ebf6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:27.789109 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-dd7e2e0b-73a6-4039-990f-cf346eea213b req-33d28fe2-301f-4b61-918f-aafbae57ebf6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:27.846006 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-dd7e2e0b-73a6-4039-990f-cf346eea213b req-33d28fe2-301f-4b61-918f-aafbae57ebf6 admin admin] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:27.846778 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-dd7e2e0b-73a6-4039-990f-cf346eea213b req-33d28fe2-301f-4b61-918f-aafbae57ebf6 admin admin] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:27.847372 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-dd7e2e0b-73a6-4039-990f-cf346eea213b req-33d28fe2-301f-4b61-918f-aafbae57ebf6 admin admin] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:27.868630 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:27.877026 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-dd7e2e0b-73a6-4039-990f-cf346eea213b req-33d28fe2-301f-4b61-918f-aafbae57ebf6 admin admin] 10.222.0.18 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.374296 Oct 19 00:42:27.878347 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 209/381] 10.222.0.18 () {64 vars in 1326 bytes} [Wed Oct 19 00:42:27 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:42:28.276914 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-98803963-5b5d-4483-b59d-27dcedcde056 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:28.277553 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-98803963-5b5d-4483-b59d-27dcedcde056 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:28.291337 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-98803963-5b5d-4483-b59d-27dcedcde056 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:28.296705 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-98803963-5b5d-4483-b59d-27dcedcde056 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:28.297163 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-98803963-5b5d-4483-b59d-27dcedcde056 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:28.298276 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-98803963-5b5d-4483-b59d-27dcedcde056 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:28.298787 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-98803963-5b5d-4483-b59d-27dcedcde056 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:28.299516 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-98803963-5b5d-4483-b59d-27dcedcde056 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:28.506014 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-98803963-5b5d-4483-b59d-27dcedcde056 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:28.516687 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-98803963-5b5d-4483-b59d-27dcedcde056 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:28.518550 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-98803963-5b5d-4483-b59d-27dcedcde056 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:28.520100 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-98803963-5b5d-4483-b59d-27dcedcde056 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1722 microversion: 2.20 time: 0.249136 Oct 19 00:42:28.520812 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 173/382] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:42:28 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:42:29.163388 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-99cbe688-1cf9-4509-b05e-4ac5d03758b4 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Action: 'create', calling method: .version_select at 0x7f81f11009d0>, body: {"keypair": {"name": "tempest-keypair-2106051418", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbE95Pxv+G6Om8I5X95ffE/Mfpw52SfOyxqgj4eV3dS/z8zohG7GUAx4lxbkNbF0kr0OL6onlfmWBG66I5ayO1WYdVi2Mp07ZpEFhpzKbbpvBVH4kKm0Iz1mhH19qYshg=="}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:42:29.183979 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.quota [None req-99cbe688-1cf9-4509-b05e-4ac5d03758b4 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Getting quotas for project 4081d4f735b04367a67a03b9539f5432. Resources: {'key_pairs'} {{(pid=125532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:42:29.189263 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.quota [None req-99cbe688-1cf9-4509-b05e-4ac5d03758b4 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Getting quotas for user 5f9a55c605f04f478d0a71679d8bf6a1 and project 4081d4f735b04367a67a03b9539f5432. Resources: {'key_pairs'} {{(pid=125532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:42:29.220661 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-99cbe688-1cf9-4509-b05e-4ac5d03758b4 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.067462 Oct 19 00:42:29.221561 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 210/383] 10.222.0.33 () {60 vars in 1159 bytes} [Wed Oct 19 00:42:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:42:29.554246 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-bf82740c-ac9c-4d6e-9281-7ad79f3bc2e2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:29.555185 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-bf82740c-ac9c-4d6e-9281-7ad79f3bc2e2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:29.573077 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bf82740c-ac9c-4d6e-9281-7ad79f3bc2e2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:29.573587 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bf82740c-ac9c-4d6e-9281-7ad79f3bc2e2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:29.574325 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bf82740c-ac9c-4d6e-9281-7ad79f3bc2e2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:29.577582 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bf82740c-ac9c-4d6e-9281-7ad79f3bc2e2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:29.578271 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bf82740c-ac9c-4d6e-9281-7ad79f3bc2e2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:29.578884 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bf82740c-ac9c-4d6e-9281-7ad79f3bc2e2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:29.869294 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-bf82740c-ac9c-4d6e-9281-7ad79f3bc2e2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:29.881774 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-bf82740c-ac9c-4d6e-9281-7ad79f3bc2e2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:29.883457 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-bf82740c-ac9c-4d6e-9281-7ad79f3bc2e2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:29.889414 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-bf82740c-ac9c-4d6e-9281-7ad79f3bc2e2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1722 microversion: 2.20 time: 0.343790 Oct 19 00:42:29.891416 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 174/384] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:42:29 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1722 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:42:30.919778 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-a13767f9-29f8-4230-9913-71c2daed7748 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:30.921418 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-a13767f9-29f8-4230-9913-71c2daed7748 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:30.947973 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a13767f9-29f8-4230-9913-71c2daed7748 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:30.948825 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a13767f9-29f8-4230-9913-71c2daed7748 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:30.950090 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a13767f9-29f8-4230-9913-71c2daed7748 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:30.951018 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a13767f9-29f8-4230-9913-71c2daed7748 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:30.951788 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a13767f9-29f8-4230-9913-71c2daed7748 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:30.952402 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a13767f9-29f8-4230-9913-71c2daed7748 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:31.121510 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-389f1caf-fbf2-4d48-930d-e369b1742bff tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-261465574", "imageRef": "d1f4abc9-3bb9-4343-9a05-53d758070c9d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e4e49b3c-1347-4eda-9be1-f1139c6e3c46"}], "security_groups": [{"name": "tempest-securitygroup--2027336322"}], "key_name": "tempest-keypair-2106051418", "user_data": "}} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:42:31.248043 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-a13767f9-29f8-4230-9913-71c2daed7748 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:31.269300 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-a13767f9-29f8-4230-9913-71c2daed7748 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:31.279742 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-a13767f9-29f8-4230-9913-71c2daed7748 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:31.283892 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-a13767f9-29f8-4230-9913-71c2daed7748 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1722 microversion: 2.20 time: 0.368563 Oct 19 00:42:31.297579 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.network.neutron [None req-389f1caf-fbf2-4d48-930d-e369b1742bff tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] validate_networks() for [('e4e49b3c-1347-4eda-9be1-f1139c6e3c46', None, None, None, None, None)] {{(pid=125531) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:42:31.308358 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 211/385] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:42:30 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1722 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:42:31.862942 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-389f1caf-fbf2-4d48-930d-e369b1742bff tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Flavor limits 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:42:31.863666 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-389f1caf-fbf2-4d48-930d-e369b1742bff tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Image limits 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:42:31.864273 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-389f1caf-fbf2-4d48-930d-e369b1742bff tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Flavor pref 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:42:31.864786 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-389f1caf-fbf2-4d48-930d-e369b1742bff tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Image pref 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:42:31.865934 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-389f1caf-fbf2-4d48-930d-e369b1742bff tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:42:31.876290 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-389f1caf-fbf2-4d48-930d-e369b1742bff tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:31.877106 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-389f1caf-fbf2-4d48-930d-e369b1742bff tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:31.877781 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-389f1caf-fbf2-4d48-930d-e369b1742bff tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:31.878750 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-389f1caf-fbf2-4d48-930d-e369b1742bff tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:31.879420 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-389f1caf-fbf2-4d48-930d-e369b1742bff tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:31.880089 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-389f1caf-fbf2-4d48-930d-e369b1742bff tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:31.899400 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.quota [None req-389f1caf-fbf2-4d48-930d-e369b1742bff tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Getting quotas for project 4081d4f735b04367a67a03b9539f5432. Resources: {'instances', 'cores', 'ram'} {{(pid=125531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:42:31.904910 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.quota [None req-389f1caf-fbf2-4d48-930d-e369b1742bff tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Getting quotas for user 5f9a55c605f04f478d0a71679d8bf6a1 and project 4081d4f735b04367a67a03b9539f5432. Resources: {'instances', 'cores', 'ram'} {{(pid=125531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:42:31.918677 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-389f1caf-fbf2-4d48-930d-e369b1742bff tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Going to run 1 instances... {{(pid=125531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:42:31.921122 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-389f1caf-fbf2-4d48-930d-e369b1742bff tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1f4abc9-3bb9-4343-9a05-53d758070c9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:42:31.982356 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-389f1caf-fbf2-4d48-930d-e369b1742bff tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.865731 Oct 19 00:42:31.983699 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 175/386] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Oct 19 00:42:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:42:31.997521 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-96739a41-75db-4e07-ae54-c4437c54a13e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:31.998971 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-96739a41-75db-4e07-ae54-c4437c54a13e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:32.085201 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-96739a41-75db-4e07-ae54-c4437c54a13e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:32.096802 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-96739a41-75db-4e07-ae54-c4437c54a13e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7" status: 200 len: 1241 microversion: 2.1 time: 0.104159 Oct 19 00:42:32.112577 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 212/387] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:31 2022] GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 => generated 1241 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:32.319388 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-31f6b3ea-d3f3-4c2f-bb2f-95a5ea253158 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:32.320189 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-31f6b3ea-d3f3-4c2f-bb2f-95a5ea253158 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:32.332734 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-31f6b3ea-d3f3-4c2f-bb2f-95a5ea253158 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:32.333518 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-31f6b3ea-d3f3-4c2f-bb2f-95a5ea253158 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:32.335870 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-31f6b3ea-d3f3-4c2f-bb2f-95a5ea253158 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:32.337159 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-31f6b3ea-d3f3-4c2f-bb2f-95a5ea253158 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:32.337809 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-31f6b3ea-d3f3-4c2f-bb2f-95a5ea253158 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:32.338644 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-31f6b3ea-d3f3-4c2f-bb2f-95a5ea253158 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:32.603658 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-31f6b3ea-d3f3-4c2f-bb2f-95a5ea253158 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:32.618791 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-31f6b3ea-d3f3-4c2f-bb2f-95a5ea253158 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:32.620655 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-31f6b3ea-d3f3-4c2f-bb2f-95a5ea253158 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:32.621981 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-31f6b3ea-d3f3-4c2f-bb2f-95a5ea253158 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1722 microversion: 2.20 time: 0.308312 Oct 19 00:42:32.627354 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 176/388] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:42:32 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1722 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:42:33.122724 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-d964e98b-5aa2-4c7d-aab1-7e39ab1febac tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:33.124175 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-d964e98b-5aa2-4c7d-aab1-7e39ab1febac tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:33.133108 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d964e98b-5aa2-4c7d-aab1-7e39ab1febac tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:33.133928 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d964e98b-5aa2-4c7d-aab1-7e39ab1febac tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:33.134517 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d964e98b-5aa2-4c7d-aab1-7e39ab1febac tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:33.135380 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d964e98b-5aa2-4c7d-aab1-7e39ab1febac tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:33.136037 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d964e98b-5aa2-4c7d-aab1-7e39ab1febac tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:33.137240 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d964e98b-5aa2-4c7d-aab1-7e39ab1febac tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:33.285503 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-d964e98b-5aa2-4c7d-aab1-7e39ab1febac tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:33.295585 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-d964e98b-5aa2-4c7d-aab1-7e39ab1febac tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7" status: 200 len: 1293 microversion: 2.1 time: 0.177274 Oct 19 00:42:33.299175 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 213/389] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:33 2022] GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 => generated 1293 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:33.658073 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-c84ec97f-623e-4812-8eb3-34e6c49a2b29 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:33.660266 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-c84ec97f-623e-4812-8eb3-34e6c49a2b29 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:33.661138 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:33.667899 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c84ec97f-623e-4812-8eb3-34e6c49a2b29 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:33.668392 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c84ec97f-623e-4812-8eb3-34e6c49a2b29 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:33.668829 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c84ec97f-623e-4812-8eb3-34e6c49a2b29 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:33.669527 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c84ec97f-623e-4812-8eb3-34e6c49a2b29 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:33.672267 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c84ec97f-623e-4812-8eb3-34e6c49a2b29 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:33.672717 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c84ec97f-623e-4812-8eb3-34e6c49a2b29 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:33.872169 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-3957645d-1857-4fb1-be4f-67c42b54f4cb req-faf334fe-00f7-4644-98c6-9f55b56d0f94 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "df3dcba1-7afd-4b49-a531-a0af55908ad8", "create_info": {"type": "qcow2", "new_file": "volume-df3dcba1-7afd-4b49-a531-a0af55908ad8.359ed470-bb2b-464b-951d-014e3aa728e4.vhdx", "snapshot_id": "359ed470-bb2b-464b-951d-014e3aa728e4"}}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:42:33.879719 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-3957645d-1857-4fb1-be4f-67c42b54f4cb req-faf334fe-00f7-4644-98c6-9f55b56d0f94 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:33.901890 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-3957645d-1857-4fb1-be4f-67c42b54f4cb req-faf334fe-00f7-4644-98c6-9f55b56d0f94 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:33.902576 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-3957645d-1857-4fb1-be4f-67c42b54f4cb req-faf334fe-00f7-4644-98c6-9f55b56d0f94 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:33.927595 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-3957645d-1857-4fb1-be4f-67c42b54f4cb req-faf334fe-00f7-4644-98c6-9f55b56d0f94 admin admin] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:33.929013 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-3957645d-1857-4fb1-be4f-67c42b54f4cb req-faf334fe-00f7-4644-98c6-9f55b56d0f94 admin admin] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:33.937797 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-3957645d-1857-4fb1-be4f-67c42b54f4cb req-faf334fe-00f7-4644-98c6-9f55b56d0f94 admin admin] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:33.982940 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-3957645d-1857-4fb1-be4f-67c42b54f4cb req-faf334fe-00f7-4644-98c6-9f55b56d0f94 admin admin] 10.222.0.18 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.186266 Oct 19 00:42:33.984145 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 214/390] 10.222.0.18 () {64 vars in 1326 bytes} [Wed Oct 19 00:42:33 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 19 00:42:34.050029 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-c84ec97f-623e-4812-8eb3-34e6c49a2b29 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:34.063025 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-c84ec97f-623e-4812-8eb3-34e6c49a2b29 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:34.065349 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-c84ec97f-623e-4812-8eb3-34e6c49a2b29 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:34.067603 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-c84ec97f-623e-4812-8eb3-34e6c49a2b29 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1722 microversion: 2.20 time: 0.413647 Oct 19 00:42:34.069764 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 177/391] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:42:33 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1722 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:42:34.332811 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-ca5a5478-34e5-4d89-8b3f-7406f8a1008d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:34.336505 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-ca5a5478-34e5-4d89-8b3f-7406f8a1008d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:34.351491 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ca5a5478-34e5-4d89-8b3f-7406f8a1008d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:34.353969 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ca5a5478-34e5-4d89-8b3f-7406f8a1008d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:34.367811 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ca5a5478-34e5-4d89-8b3f-7406f8a1008d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:34.368964 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ca5a5478-34e5-4d89-8b3f-7406f8a1008d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:34.370058 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ca5a5478-34e5-4d89-8b3f-7406f8a1008d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:34.370675 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ca5a5478-34e5-4d89-8b3f-7406f8a1008d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:34.461810 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-ca5a5478-34e5-4d89-8b3f-7406f8a1008d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:34.472260 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-ca5a5478-34e5-4d89-8b3f-7406f8a1008d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7" status: 200 len: 1299 microversion: 2.1 time: 0.153693 Oct 19 00:42:34.472905 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 215/392] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:34 2022] GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 => generated 1299 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:35.096253 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-744a5445-7bd9-4238-94a5-2e9668e2e8d2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:35.097560 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-744a5445-7bd9-4238-94a5-2e9668e2e8d2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:35.105061 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-744a5445-7bd9-4238-94a5-2e9668e2e8d2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:35.105813 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-744a5445-7bd9-4238-94a5-2e9668e2e8d2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:35.106459 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-744a5445-7bd9-4238-94a5-2e9668e2e8d2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:35.107362 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-744a5445-7bd9-4238-94a5-2e9668e2e8d2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:35.108092 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-744a5445-7bd9-4238-94a5-2e9668e2e8d2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:35.108701 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-744a5445-7bd9-4238-94a5-2e9668e2e8d2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:35.329619 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-744a5445-7bd9-4238-94a5-2e9668e2e8d2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:35.341738 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-744a5445-7bd9-4238-94a5-2e9668e2e8d2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:35.349180 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-744a5445-7bd9-4238-94a5-2e9668e2e8d2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:35.352956 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-744a5445-7bd9-4238-94a5-2e9668e2e8d2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1722 microversion: 2.20 time: 0.260720 Oct 19 00:42:35.367685 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 178/393] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:42:35 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1722 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:42:35.497044 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-91768623-08e7-4cdb-9b8c-36726c234ff8 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:35.497669 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-91768623-08e7-4cdb-9b8c-36726c234ff8 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:35.513755 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-91768623-08e7-4cdb-9b8c-36726c234ff8 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:35.516058 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-91768623-08e7-4cdb-9b8c-36726c234ff8 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:35.516938 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-91768623-08e7-4cdb-9b8c-36726c234ff8 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:35.523833 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-91768623-08e7-4cdb-9b8c-36726c234ff8 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:35.525873 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-91768623-08e7-4cdb-9b8c-36726c234ff8 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:35.528054 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-91768623-08e7-4cdb-9b8c-36726c234ff8 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:35.621078 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-91768623-08e7-4cdb-9b8c-36726c234ff8 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:35.632844 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-91768623-08e7-4cdb-9b8c-36726c234ff8 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7" status: 200 len: 1299 microversion: 2.1 time: 0.139782 Oct 19 00:42:35.634097 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 216/394] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:35 2022] GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 => generated 1299 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:36.381199 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-8c347830-950a-4372-9e33-af7020a606ce tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:36.383051 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-8c347830-950a-4372-9e33-af7020a606ce tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:36.389895 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8c347830-950a-4372-9e33-af7020a606ce tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:36.390625 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8c347830-950a-4372-9e33-af7020a606ce tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:36.391233 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8c347830-950a-4372-9e33-af7020a606ce tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:36.391950 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8c347830-950a-4372-9e33-af7020a606ce tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:36.392547 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8c347830-950a-4372-9e33-af7020a606ce tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:36.393113 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8c347830-950a-4372-9e33-af7020a606ce tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:36.566852 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-8c347830-950a-4372-9e33-af7020a606ce tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:36.575750 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-8c347830-950a-4372-9e33-af7020a606ce tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:36.577448 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-8c347830-950a-4372-9e33-af7020a606ce tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:36.578775 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-8c347830-950a-4372-9e33-af7020a606ce tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1722 microversion: 2.20 time: 0.201952 Oct 19 00:42:36.579733 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 179/395] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:42:36 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:42:36.658362 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-e6d413cb-c9ad-4396-a048-18ad0562fd0f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:36.658984 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-e6d413cb-c9ad-4396-a048-18ad0562fd0f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:36.667313 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e6d413cb-c9ad-4396-a048-18ad0562fd0f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:36.667791 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e6d413cb-c9ad-4396-a048-18ad0562fd0f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:36.668438 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e6d413cb-c9ad-4396-a048-18ad0562fd0f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:36.669440 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e6d413cb-c9ad-4396-a048-18ad0562fd0f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:36.670167 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e6d413cb-c9ad-4396-a048-18ad0562fd0f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:36.671249 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e6d413cb-c9ad-4396-a048-18ad0562fd0f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:36.888864 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-e6d413cb-c9ad-4396-a048-18ad0562fd0f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:36.904340 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-e6d413cb-c9ad-4396-a048-18ad0562fd0f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7" status: 200 len: 1367 microversion: 2.1 time: 0.251241 Oct 19 00:42:36.905686 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 217/396] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:36 2022] GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:37.485542 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-3b266886-3c94-4a86-aa2b-ab3814bbedc7 req-dcf7c1d4-c909-4390-93bd-ce7dbfcd6de7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21c2af83-cdf5-43fb-b75e-287be2eb0db7", "tag": "c6820303-74cd-4f71-8696-e193e257c7cb"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:42:37.504967 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-3b266886-3c94-4a86-aa2b-ab3814bbedc7 req-dcf7c1d4-c909-4390-93bd-ce7dbfcd6de7 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:37.506209 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-3b266886-3c94-4a86-aa2b-ab3814bbedc7 req-dcf7c1d4-c909-4390-93bd-ce7dbfcd6de7 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:37.506938 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-3b266886-3c94-4a86-aa2b-ab3814bbedc7 req-dcf7c1d4-c909-4390-93bd-ce7dbfcd6de7 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:37.519887 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-3b266886-3c94-4a86-aa2b-ab3814bbedc7 req-dcf7c1d4-c909-4390-93bd-ce7dbfcd6de7 service nova] Creating event network-changed:c6820303-74cd-4f71-8696-e193e257c7cb for instance 21c2af83-cdf5-43fb-b75e-287be2eb0db7 on hv-cinder-maste Oct 19 00:42:37.528882 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-3b266886-3c94-4a86-aa2b-ab3814bbedc7 req-dcf7c1d4-c909-4390-93bd-ce7dbfcd6de7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046238 Oct 19 00:42:37.529849 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 180/397] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:42:37.610296 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-ee53bf4d-dea4-4981-98b3-0982ed69d0df tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:37.611252 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-ee53bf4d-dea4-4981-98b3-0982ed69d0df tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:37.619572 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ee53bf4d-dea4-4981-98b3-0982ed69d0df tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:37.620478 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ee53bf4d-dea4-4981-98b3-0982ed69d0df tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:37.621365 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ee53bf4d-dea4-4981-98b3-0982ed69d0df tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:37.621676 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ee53bf4d-dea4-4981-98b3-0982ed69d0df tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:37.622072 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ee53bf4d-dea4-4981-98b3-0982ed69d0df tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:37.622804 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ee53bf4d-dea4-4981-98b3-0982ed69d0df tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:37.895228 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-ee53bf4d-dea4-4981-98b3-0982ed69d0df tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:37.904576 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-ee53bf4d-dea4-4981-98b3-0982ed69d0df tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:37.906383 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-ee53bf4d-dea4-4981-98b3-0982ed69d0df tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:37.908252 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-ee53bf4d-dea4-4981-98b3-0982ed69d0df tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1722 microversion: 2.20 time: 0.302259 Oct 19 00:42:37.926964 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 218/398] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:42:37 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1722 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:42:37.931770 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-63fea6c6-ef66-4463-b089-2867bcb7e139 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:37.932732 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-63fea6c6-ef66-4463-b089-2867bcb7e139 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:37.942162 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-63fea6c6-ef66-4463-b089-2867bcb7e139 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:37.942656 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-63fea6c6-ef66-4463-b089-2867bcb7e139 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:37.943454 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-63fea6c6-ef66-4463-b089-2867bcb7e139 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:37.944401 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-63fea6c6-ef66-4463-b089-2867bcb7e139 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:37.945062 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-63fea6c6-ef66-4463-b089-2867bcb7e139 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:37.945714 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-63fea6c6-ef66-4463-b089-2867bcb7e139 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:38.102918 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-63fea6c6-ef66-4463-b089-2867bcb7e139 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:38.111100 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-63fea6c6-ef66-4463-b089-2867bcb7e139 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7" status: 200 len: 1367 microversion: 2.1 time: 0.184323 Oct 19 00:42:38.115897 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 181/399] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:37 2022] GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:38.333000 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-0fef2926-3df3-45e8-a540-c41d0ad2474d req-24e1a110-1767-40d8-9b80-c1fe5382313a admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "df3dcba1-7afd-4b49-a531-a0af55908ad8", "create_info": {"type": "qcow2", "new_file": "volume-df3dcba1-7afd-4b49-a531-a0af55908ad8.286b61bd-79e3-4e31-86ea-17d4e30a07f0.vhdx", "snapshot_id": "286b61bd-79e3-4e31-86ea-17d4e30a07f0"}}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:42:38.338500 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-0fef2926-3df3-45e8-a540-c41d0ad2474d req-24e1a110-1767-40d8-9b80-c1fe5382313a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:38.339347 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-0fef2926-3df3-45e8-a540-c41d0ad2474d req-24e1a110-1767-40d8-9b80-c1fe5382313a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:38.340028 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-0fef2926-3df3-45e8-a540-c41d0ad2474d req-24e1a110-1767-40d8-9b80-c1fe5382313a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:38.351211 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-0fef2926-3df3-45e8-a540-c41d0ad2474d req-24e1a110-1767-40d8-9b80-c1fe5382313a admin admin] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:38.351686 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-0fef2926-3df3-45e8-a540-c41d0ad2474d req-24e1a110-1767-40d8-9b80-c1fe5382313a admin admin] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:38.352133 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-0fef2926-3df3-45e8-a540-c41d0ad2474d req-24e1a110-1767-40d8-9b80-c1fe5382313a admin admin] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:38.367508 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-0fef2926-3df3-45e8-a540-c41d0ad2474d req-24e1a110-1767-40d8-9b80-c1fe5382313a admin admin] 10.222.0.18 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.107755 Oct 19 00:42:38.368270 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 219/400] 10.222.0.18 () {64 vars in 1326 bytes} [Wed Oct 19 00:42:38 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:42:38.938920 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-f9998e06-f1b1-413f-b822-e5cd78d75c2c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:38.939483 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-f9998e06-f1b1-413f-b822-e5cd78d75c2c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:38.946812 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f9998e06-f1b1-413f-b822-e5cd78d75c2c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:38.947632 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f9998e06-f1b1-413f-b822-e5cd78d75c2c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:38.948165 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f9998e06-f1b1-413f-b822-e5cd78d75c2c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:38.949099 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f9998e06-f1b1-413f-b822-e5cd78d75c2c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:38.949620 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f9998e06-f1b1-413f-b822-e5cd78d75c2c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:38.950243 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f9998e06-f1b1-413f-b822-e5cd78d75c2c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:39.101248 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-f9998e06-f1b1-413f-b822-e5cd78d75c2c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:39.109792 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-f9998e06-f1b1-413f-b822-e5cd78d75c2c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:39.111925 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-f9998e06-f1b1-413f-b822-e5cd78d75c2c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:39.113221 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-f9998e06-f1b1-413f-b822-e5cd78d75c2c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1722 microversion: 2.20 time: 0.178268 Oct 19 00:42:39.113875 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 182/401] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:42:38 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:42:39.139540 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-a5ac05dd-42f6-4dba-ae36-d836d18ec8b7 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:39.140967 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-a5ac05dd-42f6-4dba-ae36-d836d18ec8b7 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:39.148949 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a5ac05dd-42f6-4dba-ae36-d836d18ec8b7 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:39.149432 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a5ac05dd-42f6-4dba-ae36-d836d18ec8b7 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:39.149869 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a5ac05dd-42f6-4dba-ae36-d836d18ec8b7 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:39.150734 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a5ac05dd-42f6-4dba-ae36-d836d18ec8b7 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:39.153895 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a5ac05dd-42f6-4dba-ae36-d836d18ec8b7 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:39.154390 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a5ac05dd-42f6-4dba-ae36-d836d18ec8b7 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:39.314230 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-a5ac05dd-42f6-4dba-ae36-d836d18ec8b7 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:39.323306 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-a5ac05dd-42f6-4dba-ae36-d836d18ec8b7 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7" status: 200 len: 1367 microversion: 2.1 time: 0.188046 Oct 19 00:42:39.324123 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 220/402] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:39 2022] GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:40.145516 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-66493b60-631a-4d9b-b4c1-dd2c10ac1817 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:40.146149 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-66493b60-631a-4d9b-b4c1-dd2c10ac1817 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:40.153590 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-66493b60-631a-4d9b-b4c1-dd2c10ac1817 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:40.154243 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-66493b60-631a-4d9b-b4c1-dd2c10ac1817 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:40.154851 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-66493b60-631a-4d9b-b4c1-dd2c10ac1817 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:40.155706 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-66493b60-631a-4d9b-b4c1-dd2c10ac1817 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:40.156337 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-66493b60-631a-4d9b-b4c1-dd2c10ac1817 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:40.156923 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-66493b60-631a-4d9b-b4c1-dd2c10ac1817 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:40.163057 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:40.309590 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-66493b60-631a-4d9b-b4c1-dd2c10ac1817 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:40.319214 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-66493b60-631a-4d9b-b4c1-dd2c10ac1817 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:40.320730 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-66493b60-631a-4d9b-b4c1-dd2c10ac1817 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:40.322132 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-66493b60-631a-4d9b-b4c1-dd2c10ac1817 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1722 microversion: 2.20 time: 0.184373 Oct 19 00:42:40.322684 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 183/403] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:42:40 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:42:40.352663 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-b41b9cc2-4862-43f9-8603-6bd129005a9b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:40.353581 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-b41b9cc2-4862-43f9-8603-6bd129005a9b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:40.360819 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b41b9cc2-4862-43f9-8603-6bd129005a9b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:40.361336 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b41b9cc2-4862-43f9-8603-6bd129005a9b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:40.362054 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b41b9cc2-4862-43f9-8603-6bd129005a9b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:40.362760 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b41b9cc2-4862-43f9-8603-6bd129005a9b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:40.363213 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b41b9cc2-4862-43f9-8603-6bd129005a9b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:40.363665 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b41b9cc2-4862-43f9-8603-6bd129005a9b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:40.520590 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-b41b9cc2-4862-43f9-8603-6bd129005a9b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:40.529399 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-b41b9cc2-4862-43f9-8603-6bd129005a9b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7" status: 200 len: 1367 microversion: 2.1 time: 0.180778 Oct 19 00:42:40.530027 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 221/404] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:40 2022] GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:40.696139 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-7a10de6c-173c-4bf5-9233-703af07089ec tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:40.696723 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-7a10de6c-173c-4bf5-9233-703af07089ec tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:40.703212 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7a10de6c-173c-4bf5-9233-703af07089ec tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:40.703978 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7a10de6c-173c-4bf5-9233-703af07089ec tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:40.704718 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7a10de6c-173c-4bf5-9233-703af07089ec tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:40.705525 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7a10de6c-173c-4bf5-9233-703af07089ec tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:40.706092 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7a10de6c-173c-4bf5-9233-703af07089ec tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:40.706614 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7a10de6c-173c-4bf5-9233-703af07089ec tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:40.740941 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-7a10de6c-173c-4bf5-9233-703af07089ec tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654/ips" status: 200 len: 146 microversion: 2.1 time: 0.048214 Oct 19 00:42:40.741671 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 184/405] 10.222.0.33 () {58 vars in 1248 bytes} [Wed Oct 19 00:42:40 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654/ips => generated 146 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:42:41.197622 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-ef7eb156-6bc3-49af-99e3-ab97ca43417e tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Action: 'create', calling method: .version_select at 0x7f81f13bcca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1925025160", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIiImK7tt00U52E2Xf49b8NLgnqq5G5ITLdvR2Ayprs+KJLcfcZLyJlk2EPANsbyARYpmYbzD7XhkonlVLex1KLKSms7a48FvNb5ZpuNODbAHXg34TU2uRvjZEJEgtd9Kg=="}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:42:41.212789 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.quota [None req-ef7eb156-6bc3-49af-99e3-ab97ca43417e tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Getting quotas for project b8734b79aa064e5b9d04494ca7c5112b. Resources: {'key_pairs'} {{(pid=125532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:42:41.216568 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.quota [None req-ef7eb156-6bc3-49af-99e3-ab97ca43417e tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Getting quotas for user 53358104a2534d9084e19ca4ae59816e and project b8734b79aa064e5b9d04494ca7c5112b. Resources: {'key_pairs'} {{(pid=125532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:42:41.239475 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-ef7eb156-6bc3-49af-99e3-ab97ca43417e tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.046359 Oct 19 00:42:41.240810 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 222/406] 10.222.0.33 () {60 vars in 1159 bytes} [Wed Oct 19 00:42:41 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:42:41.292959 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-d2bc8f15-a46e-4701-8fe0-d286c8cb3ba1 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1671187087", "imageRef": "3f4c4ab7-8922-4c83-8ee7-6e5fac45d518", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1925025160", "networks": [{"uuid": "6a8abcc1-168e-4ebb-81d5-42f47a92eee0"}]}} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:42:41.348649 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-8fd39dc5-4bb2-41d1-a52b-6dec76ed6c8b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:41.349428 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-8fd39dc5-4bb2-41d1-a52b-6dec76ed6c8b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:41.356173 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8fd39dc5-4bb2-41d1-a52b-6dec76ed6c8b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:41.356782 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8fd39dc5-4bb2-41d1-a52b-6dec76ed6c8b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:41.357059 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8fd39dc5-4bb2-41d1-a52b-6dec76ed6c8b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:41.357747 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8fd39dc5-4bb2-41d1-a52b-6dec76ed6c8b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:41.358192 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8fd39dc5-4bb2-41d1-a52b-6dec76ed6c8b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:41.358608 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8fd39dc5-4bb2-41d1-a52b-6dec76ed6c8b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:41.359643 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.network.neutron [None req-d2bc8f15-a46e-4701-8fe0-d286c8cb3ba1 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] validate_networks() for [('6a8abcc1-168e-4ebb-81d5-42f47a92eee0', None, None, None, None, None)] {{(pid=125531) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:42:41.500634 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-8fd39dc5-4bb2-41d1-a52b-6dec76ed6c8b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:41.509600 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-8fd39dc5-4bb2-41d1-a52b-6dec76ed6c8b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:41.511031 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-8fd39dc5-4bb2-41d1-a52b-6dec76ed6c8b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:41.512210 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-8fd39dc5-4bb2-41d1-a52b-6dec76ed6c8b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1722 microversion: 2.20 time: 0.167430 Oct 19 00:42:41.512766 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 223/407] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:42:41 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:42:41.555807 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-8ad5702d-5a24-4746-8df2-b0f962c37061 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:41.556449 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-8ad5702d-5a24-4746-8df2-b0f962c37061 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:41.562498 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8ad5702d-5a24-4746-8df2-b0f962c37061 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:41.562981 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8ad5702d-5a24-4746-8df2-b0f962c37061 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:41.563409 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8ad5702d-5a24-4746-8df2-b0f962c37061 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:41.564613 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8ad5702d-5a24-4746-8df2-b0f962c37061 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:41.564863 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8ad5702d-5a24-4746-8df2-b0f962c37061 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:41.565281 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8ad5702d-5a24-4746-8df2-b0f962c37061 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:41.733582 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-8ad5702d-5a24-4746-8df2-b0f962c37061 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:41.745075 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-8ad5702d-5a24-4746-8df2-b0f962c37061 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7" status: 200 len: 1367 microversion: 2.1 time: 0.193703 Oct 19 00:42:41.756750 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 224/408] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:41 2022] GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:41.781343 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-d2bc8f15-a46e-4701-8fe0-d286c8cb3ba1 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Flavor limits 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:42:41.781777 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-d2bc8f15-a46e-4701-8fe0-d286c8cb3ba1 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Image limits 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:42:41.782513 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-d2bc8f15-a46e-4701-8fe0-d286c8cb3ba1 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Flavor pref 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:42:41.782960 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-d2bc8f15-a46e-4701-8fe0-d286c8cb3ba1 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Image pref 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:42:41.783429 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-d2bc8f15-a46e-4701-8fe0-d286c8cb3ba1 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:42:41.793621 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d2bc8f15-a46e-4701-8fe0-d286c8cb3ba1 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:41.794107 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d2bc8f15-a46e-4701-8fe0-d286c8cb3ba1 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:41.794543 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d2bc8f15-a46e-4701-8fe0-d286c8cb3ba1 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:41.795305 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d2bc8f15-a46e-4701-8fe0-d286c8cb3ba1 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:41.795707 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d2bc8f15-a46e-4701-8fe0-d286c8cb3ba1 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:41.796163 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d2bc8f15-a46e-4701-8fe0-d286c8cb3ba1 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:41.813180 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.quota [None req-d2bc8f15-a46e-4701-8fe0-d286c8cb3ba1 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Getting quotas for project b8734b79aa064e5b9d04494ca7c5112b. Resources: {'instances', 'cores', 'ram'} {{(pid=125531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:42:41.817328 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.quota [None req-d2bc8f15-a46e-4701-8fe0-d286c8cb3ba1 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Getting quotas for user 53358104a2534d9084e19ca4ae59816e and project b8734b79aa064e5b9d04494ca7c5112b. Resources: {'instances', 'cores', 'ram'} {{(pid=125531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:42:41.829584 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-d2bc8f15-a46e-4701-8fe0-d286c8cb3ba1 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Going to run 1 instances... {{(pid=125531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:42:41.831920 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-d2bc8f15-a46e-4701-8fe0-d286c8cb3ba1 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4c4ab7-8922-4c83-8ee7-6e5fac45d518',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:42:41.887112 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-d2bc8f15-a46e-4701-8fe0-d286c8cb3ba1 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598167 Oct 19 00:42:41.888409 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 185/409] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Oct 19 00:42:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:42:41.900115 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-d0287b14-bb5e-4c46-846e-d3ca88562017 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:41.901327 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-d0287b14-bb5e-4c46-846e-d3ca88562017 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:41.984600 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-d0287b14-bb5e-4c46-846e-d3ca88562017 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:41.991656 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-d0287b14-bb5e-4c46-846e-d3ca88562017 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1259 microversion: 2.1 time: 0.096244 Oct 19 00:42:41.992276 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 225/410] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:41 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1259 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:42.537590 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-dabcded9-5463-41fc-aa51-4bad9f0b00e8 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:42.538366 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-dabcded9-5463-41fc-aa51-4bad9f0b00e8 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:42.547710 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dabcded9-5463-41fc-aa51-4bad9f0b00e8 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:42.547870 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dabcded9-5463-41fc-aa51-4bad9f0b00e8 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:42.548517 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dabcded9-5463-41fc-aa51-4bad9f0b00e8 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:42.549430 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dabcded9-5463-41fc-aa51-4bad9f0b00e8 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:42.550066 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dabcded9-5463-41fc-aa51-4bad9f0b00e8 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:42.550656 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dabcded9-5463-41fc-aa51-4bad9f0b00e8 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:42.697988 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-dabcded9-5463-41fc-aa51-4bad9f0b00e8 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:42.706004 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-dabcded9-5463-41fc-aa51-4bad9f0b00e8 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:42.707447 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-dabcded9-5463-41fc-aa51-4bad9f0b00e8 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:42.708678 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-dabcded9-5463-41fc-aa51-4bad9f0b00e8 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1722 microversion: 2.20 time: 0.175637 Oct 19 00:42:42.709435 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 186/411] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:42:42 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:42:42.769712 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-defe40bb-c4c8-455e-9f23-6d259457fb23 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:42.770336 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-defe40bb-c4c8-455e-9f23-6d259457fb23 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:42.776770 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-defe40bb-c4c8-455e-9f23-6d259457fb23 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:42.777271 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-defe40bb-c4c8-455e-9f23-6d259457fb23 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:42.777700 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-defe40bb-c4c8-455e-9f23-6d259457fb23 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:42.778384 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-defe40bb-c4c8-455e-9f23-6d259457fb23 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:42.778831 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-defe40bb-c4c8-455e-9f23-6d259457fb23 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:42.779250 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-defe40bb-c4c8-455e-9f23-6d259457fb23 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:42.905642 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-defe40bb-c4c8-455e-9f23-6d259457fb23 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:42.913849 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-defe40bb-c4c8-455e-9f23-6d259457fb23 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7" status: 200 len: 1367 microversion: 2.1 time: 0.148047 Oct 19 00:42:42.914412 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 226/412] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:42 2022] GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:42.991014 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-1d8bfaf2-75d1-416e-8622-9799f5b7f4df tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9629836-fa7b-46c1-99b9-165b78ecc003"}} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:42:42.993523 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-1d8bfaf2-75d1-416e-8622-9799f5b7f4df tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:42.999604 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1d8bfaf2-75d1-416e-8622-9799f5b7f4df tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:43.000131 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1d8bfaf2-75d1-416e-8622-9799f5b7f4df tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:43.000571 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1d8bfaf2-75d1-416e-8622-9799f5b7f4df tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:43.001264 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1d8bfaf2-75d1-416e-8622-9799f5b7f4df tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:43.001716 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1d8bfaf2-75d1-416e-8622-9799f5b7f4df tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:43.002141 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1d8bfaf2-75d1-416e-8622-9799f5b7f4df tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:43.014028 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-08ff7d61-b59d-4570-bfb9-a8baf4ff1242 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:43.014640 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-08ff7d61-b59d-4570-bfb9-a8baf4ff1242 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:43.020440 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-08ff7d61-b59d-4570-bfb9-a8baf4ff1242 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:43.020913 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-08ff7d61-b59d-4570-bfb9-a8baf4ff1242 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:43.021347 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-08ff7d61-b59d-4570-bfb9-a8baf4ff1242 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:43.022135 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-08ff7d61-b59d-4570-bfb9-a8baf4ff1242 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:43.022587 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-08ff7d61-b59d-4570-bfb9-a8baf4ff1242 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:43.023007 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-08ff7d61-b59d-4570-bfb9-a8baf4ff1242 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:43.083836 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-08ff7d61-b59d-4570-bfb9-a8baf4ff1242 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:43.091423 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-08ff7d61-b59d-4570-bfb9-a8baf4ff1242 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1255 microversion: 2.1 time: 0.081178 Oct 19 00:42:43.092007 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 227/413] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:43 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1255 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:42:43.733431 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-1f1d2b2c-16ca-4429-8914-15e1bad3920c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:43.734068 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-1f1d2b2c-16ca-4429-8914-15e1bad3920c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:43.744721 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1f1d2b2c-16ca-4429-8914-15e1bad3920c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:43.745311 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1f1d2b2c-16ca-4429-8914-15e1bad3920c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:43.745916 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1f1d2b2c-16ca-4429-8914-15e1bad3920c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:43.746852 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1f1d2b2c-16ca-4429-8914-15e1bad3920c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:43.747816 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1f1d2b2c-16ca-4429-8914-15e1bad3920c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:43.748620 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1f1d2b2c-16ca-4429-8914-15e1bad3920c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:43.878641 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-1f1d2b2c-16ca-4429-8914-15e1bad3920c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:43.887137 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-1f1d2b2c-16ca-4429-8914-15e1bad3920c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:43.888595 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-1f1d2b2c-16ca-4429-8914-15e1bad3920c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:43.889734 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-1f1d2b2c-16ca-4429-8914-15e1bad3920c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1743 microversion: 2.20 time: 0.160246 Oct 19 00:42:43.890287 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 228/414] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:42:43 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:42:43.935695 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-e2c49197-8d92-4825-a26b-233d9676bf85 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:43.936406 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-e2c49197-8d92-4825-a26b-233d9676bf85 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:43.942204 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e2c49197-8d92-4825-a26b-233d9676bf85 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:43.942681 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e2c49197-8d92-4825-a26b-233d9676bf85 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:43.943719 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e2c49197-8d92-4825-a26b-233d9676bf85 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:43.944616 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e2c49197-8d92-4825-a26b-233d9676bf85 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:43.945067 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e2c49197-8d92-4825-a26b-233d9676bf85 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:43.945488 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e2c49197-8d92-4825-a26b-233d9676bf85 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:44.077144 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-e2c49197-8d92-4825-a26b-233d9676bf85 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:44.084969 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-e2c49197-8d92-4825-a26b-233d9676bf85 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7" status: 200 len: 1367 microversion: 2.1 time: 0.152857 Oct 19 00:42:44.085535 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 229/415] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:43 2022] GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:42:44.114606 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-2529005f-79fc-41bb-b2b6-898b655e474d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:44.115757 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-2529005f-79fc-41bb-b2b6-898b655e474d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:44.122718 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2529005f-79fc-41bb-b2b6-898b655e474d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:44.123206 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2529005f-79fc-41bb-b2b6-898b655e474d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:44.123641 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2529005f-79fc-41bb-b2b6-898b655e474d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:44.124372 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2529005f-79fc-41bb-b2b6-898b655e474d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:44.124831 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2529005f-79fc-41bb-b2b6-898b655e474d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:44.125256 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2529005f-79fc-41bb-b2b6-898b655e474d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:44.186656 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-2529005f-79fc-41bb-b2b6-898b655e474d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:44.195030 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-2529005f-79fc-41bb-b2b6-898b655e474d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1311 microversion: 2.1 time: 0.084374 Oct 19 00:42:44.195776 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 230/416] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:44 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1311 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:42:44.500073 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-1d8bfaf2-75d1-416e-8622-9799f5b7f4df tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "POST /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.513815 Oct 19 00:42:44.506292 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 187/417] 10.222.0.33 () {60 vars in 1323 bytes} [Wed Oct 19 00:42:42 2022] POST /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654/os-volume_attachments => generated 194 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:42:44.915832 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-cd227952-2d2c-48aa-9327-4990ec20d868 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:44.916467 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-cd227952-2d2c-48aa-9327-4990ec20d868 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:44.922760 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cd227952-2d2c-48aa-9327-4990ec20d868 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:44.923231 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cd227952-2d2c-48aa-9327-4990ec20d868 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:44.923658 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cd227952-2d2c-48aa-9327-4990ec20d868 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:44.924359 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cd227952-2d2c-48aa-9327-4990ec20d868 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:44.924801 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cd227952-2d2c-48aa-9327-4990ec20d868 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:44.925213 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cd227952-2d2c-48aa-9327-4990ec20d868 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:45.054699 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-cd227952-2d2c-48aa-9327-4990ec20d868 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:45.057036 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell1:SELECT=100 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:45.064153 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-cd227952-2d2c-48aa-9327-4990ec20d868 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:45.065606 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-cd227952-2d2c-48aa-9327-4990ec20d868 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:45.066748 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-cd227952-2d2c-48aa-9327-4990ec20d868 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1743 microversion: 2.20 time: 0.156049 Oct 19 00:42:45.067297 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 231/418] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:42:44 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:42:45.108850 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-0c3a3edf-0063-4e0a-ac62-3eb57f3e6120 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:45.109682 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-0c3a3edf-0063-4e0a-ac62-3eb57f3e6120 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:45.116117 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0c3a3edf-0063-4e0a-ac62-3eb57f3e6120 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:45.116605 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0c3a3edf-0063-4e0a-ac62-3eb57f3e6120 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:45.117043 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0c3a3edf-0063-4e0a-ac62-3eb57f3e6120 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:45.117847 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0c3a3edf-0063-4e0a-ac62-3eb57f3e6120 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:45.118304 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0c3a3edf-0063-4e0a-ac62-3eb57f3e6120 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:45.118722 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0c3a3edf-0063-4e0a-ac62-3eb57f3e6120 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:45.221693 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-ef22ade9-7da4-452f-a276-adf0566dfa15 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:45.222600 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-ef22ade9-7da4-452f-a276-adf0566dfa15 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:45.241232 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ef22ade9-7da4-452f-a276-adf0566dfa15 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:45.242125 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ef22ade9-7da4-452f-a276-adf0566dfa15 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:45.242952 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ef22ade9-7da4-452f-a276-adf0566dfa15 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:45.244685 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ef22ade9-7da4-452f-a276-adf0566dfa15 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:45.245450 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ef22ade9-7da4-452f-a276-adf0566dfa15 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:45.246267 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ef22ade9-7da4-452f-a276-adf0566dfa15 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:45.268993 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-0c3a3edf-0063-4e0a-ac62-3eb57f3e6120 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:45.280368 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-0c3a3edf-0063-4e0a-ac62-3eb57f3e6120 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7" status: 200 len: 1367 microversion: 2.1 time: 0.176059 Oct 19 00:42:45.281542 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 188/419] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:45 2022] GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:45.286432 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-fc66e71e-d0b2-455e-a694-f135bd1cea1a req-716c486d-4425-4389-aeeb-62383b373e91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21c2af83-cdf5-43fb-b75e-287be2eb0db7", "name": "network-vif-plugged", "status": "completed", "tag": "c6820303-74cd-4f71-8696-e193e257c7cb"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:42:45.297636 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-fc66e71e-d0b2-455e-a694-f135bd1cea1a req-716c486d-4425-4389-aeeb-62383b373e91 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:45.298343 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-fc66e71e-d0b2-455e-a694-f135bd1cea1a req-716c486d-4425-4389-aeeb-62383b373e91 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:45.298927 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-fc66e71e-d0b2-455e-a694-f135bd1cea1a req-716c486d-4425-4389-aeeb-62383b373e91 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:45.315029 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-fc66e71e-d0b2-455e-a694-f135bd1cea1a req-716c486d-4425-4389-aeeb-62383b373e91 service nova] Creating event network-vif-plugged:c6820303-74cd-4f71-8696-e193e257c7cb for instance 21c2af83-cdf5-43fb-b75e-287be2eb0db7 on hv-cinder-maste Oct 19 00:42:45.323654 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-fc66e71e-d0b2-455e-a694-f135bd1cea1a req-716c486d-4425-4389-aeeb-62383b373e91 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040631 Oct 19 00:42:45.324555 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 189/420] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:42:45.331937 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-ef22ade9-7da4-452f-a276-adf0566dfa15 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:45.341202 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-ef22ade9-7da4-452f-a276-adf0566dfa15 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1311 microversion: 2.1 time: 0.125095 Oct 19 00:42:45.341780 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 232/421] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:45 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1311 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:45.499878 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-c7c25419-4ab3-4c48-89e5-3e903a984675 req-8f3251cc-3aab-4e02-a373-69881a640757 admin admin] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:45.508443 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [req-c7c25419-4ab3-4c48-89e5-3e903a984675 req-8f3251cc-3aab-4e02-a373-69881a640757 admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab(cell1) {{(pid=125531) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 19 00:42:45.508988 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-c7c25419-4ab3-4c48-89e5-3e903a984675 req-8f3251cc-3aab-4e02-a373-69881a640757 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:45.509350 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-c7c25419-4ab3-4c48-89e5-3e903a984675 req-8f3251cc-3aab-4e02-a373-69881a640757 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:45.509776 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-c7c25419-4ab3-4c48-89e5-3e903a984675 req-8f3251cc-3aab-4e02-a373-69881a640757 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:45.548564 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-c7c25419-4ab3-4c48-89e5-3e903a984675 req-8f3251cc-3aab-4e02-a373-69881a640757 admin admin] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:45.549032 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-c7c25419-4ab3-4c48-89e5-3e903a984675 req-8f3251cc-3aab-4e02-a373-69881a640757 admin admin] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:45.549461 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-c7c25419-4ab3-4c48-89e5-3e903a984675 req-8f3251cc-3aab-4e02-a373-69881a640757 admin admin] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:45.572792 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-c7c25419-4ab3-4c48-89e5-3e903a984675 req-8f3251cc-3aab-4e02-a373-69881a640757 admin admin] 10.222.0.18 "DELETE /compute/v2.1/os-assisted-volume-snapshots/fd331631-0d94-412c-9be2-3465f598aa3a?delete_info=%7B%22file_to_merge%22:%20%22volume-df3dcba1-7afd-4b49-a531-a0af55908ad8.fd331631-0d94-412c-9be2-3465f598aa3a.vhdx%22,%20%22volume_id%22:%20%22df3dcba1-7afd-4b49-a531-a0af55908ad8%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.126556 Oct 19 00:42:45.573364 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 190/422] 10.222.0.18 () {62 vars in 1800 bytes} [Wed Oct 19 00:42:45 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/fd331631-0d94-412c-9be2-3465f598aa3a?delete_info=%7B%22file_to_merge%22:%20%22volume-df3dcba1-7afd-4b49-a531-a0af55908ad8.fd331631-0d94-412c-9be2-3465f598aa3a.vhdx%22,%20%22volume_id%22:%20%22df3dcba1-7afd-4b49-a531-a0af55908ad8%22%7D => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:42:46.092713 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-c13f5ea3-b750-4428-973d-ae3cda63f986 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:46.093459 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-c13f5ea3-b750-4428-973d-ae3cda63f986 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:46.100500 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c13f5ea3-b750-4428-973d-ae3cda63f986 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:46.101077 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c13f5ea3-b750-4428-973d-ae3cda63f986 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:46.101583 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c13f5ea3-b750-4428-973d-ae3cda63f986 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:46.102343 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c13f5ea3-b750-4428-973d-ae3cda63f986 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:46.102866 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c13f5ea3-b750-4428-973d-ae3cda63f986 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:46.103359 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c13f5ea3-b750-4428-973d-ae3cda63f986 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:46.232695 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-c13f5ea3-b750-4428-973d-ae3cda63f986 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:46.242097 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-c13f5ea3-b750-4428-973d-ae3cda63f986 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:46.243541 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-c13f5ea3-b750-4428-973d-ae3cda63f986 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:46.244740 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-c13f5ea3-b750-4428-973d-ae3cda63f986 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1743 microversion: 2.20 time: 0.156021 Oct 19 00:42:46.245301 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 233/423] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:42:46 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:42:46.303799 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-21de1b23-b207-47dd-840a-d3038cf48758 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:46.304553 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-21de1b23-b207-47dd-840a-d3038cf48758 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:46.310733 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-21de1b23-b207-47dd-840a-d3038cf48758 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:46.311217 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-21de1b23-b207-47dd-840a-d3038cf48758 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:46.311650 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-21de1b23-b207-47dd-840a-d3038cf48758 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:46.312395 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-21de1b23-b207-47dd-840a-d3038cf48758 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:46.312856 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-21de1b23-b207-47dd-840a-d3038cf48758 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:46.313280 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-21de1b23-b207-47dd-840a-d3038cf48758 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:46.363177 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-26951afc-460b-4924-888a-36e54a39a30f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:46.363794 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-26951afc-460b-4924-888a-36e54a39a30f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:46.370135 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-26951afc-460b-4924-888a-36e54a39a30f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:46.370828 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-26951afc-460b-4924-888a-36e54a39a30f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:46.371516 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-26951afc-460b-4924-888a-36e54a39a30f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:46.372057 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-26951afc-460b-4924-888a-36e54a39a30f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:46.372516 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-26951afc-460b-4924-888a-36e54a39a30f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:46.372947 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-26951afc-460b-4924-888a-36e54a39a30f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:46.434218 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-26951afc-460b-4924-888a-36e54a39a30f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:46.441748 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-26951afc-460b-4924-888a-36e54a39a30f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1329 microversion: 2.1 time: 0.082743 Oct 19 00:42:46.442322 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 234/424] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:46 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1329 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:42:46.447199 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-21de1b23-b207-47dd-840a-d3038cf48758 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:46.454871 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-21de1b23-b207-47dd-840a-d3038cf48758 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7" status: 200 len: 1367 microversion: 2.1 time: 0.155771 Oct 19 00:42:46.455417 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 191/425] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:46 2022] GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:42:47.270290 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-a65d4b9d-8ee7-4fba-9d0e-f7fe1b88732b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:47.270902 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-a65d4b9d-8ee7-4fba-9d0e-f7fe1b88732b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:47.277373 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a65d4b9d-8ee7-4fba-9d0e-f7fe1b88732b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:47.277854 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a65d4b9d-8ee7-4fba-9d0e-f7fe1b88732b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:47.278284 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a65d4b9d-8ee7-4fba-9d0e-f7fe1b88732b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:47.278975 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a65d4b9d-8ee7-4fba-9d0e-f7fe1b88732b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:47.279598 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a65d4b9d-8ee7-4fba-9d0e-f7fe1b88732b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:47.280056 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a65d4b9d-8ee7-4fba-9d0e-f7fe1b88732b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:47.409022 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-a65d4b9d-8ee7-4fba-9d0e-f7fe1b88732b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:47.418050 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-a65d4b9d-8ee7-4fba-9d0e-f7fe1b88732b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:47.419425 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-a65d4b9d-8ee7-4fba-9d0e-f7fe1b88732b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:47.420732 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-a65d4b9d-8ee7-4fba-9d0e-f7fe1b88732b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1743 microversion: 2.20 time: 0.154218 Oct 19 00:42:47.421207 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 235/426] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:42:47 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:42:47.464224 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-27cc78ac-fb09-4eba-b2bf-3e4289f571ba tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:47.464834 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-27cc78ac-fb09-4eba-b2bf-3e4289f571ba tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:47.471177 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-27cc78ac-fb09-4eba-b2bf-3e4289f571ba tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:47.471653 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-27cc78ac-fb09-4eba-b2bf-3e4289f571ba tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:47.472117 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-27cc78ac-fb09-4eba-b2bf-3e4289f571ba tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:47.472998 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-27cc78ac-fb09-4eba-b2bf-3e4289f571ba tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:47.473629 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-27cc78ac-fb09-4eba-b2bf-3e4289f571ba tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:47.474057 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-27cc78ac-fb09-4eba-b2bf-3e4289f571ba tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:47.477607 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-6e5f3df6-a851-429a-896f-db311c06d6cc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:47.478213 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-6e5f3df6-a851-429a-896f-db311c06d6cc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:47.484051 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6e5f3df6-a851-429a-896f-db311c06d6cc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:47.484528 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6e5f3df6-a851-429a-896f-db311c06d6cc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:47.484956 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6e5f3df6-a851-429a-896f-db311c06d6cc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:47.485635 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6e5f3df6-a851-429a-896f-db311c06d6cc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:47.486080 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6e5f3df6-a851-429a-896f-db311c06d6cc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:47.486493 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6e5f3df6-a851-429a-896f-db311c06d6cc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:47.535330 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-27cc78ac-fb09-4eba-b2bf-3e4289f571ba tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:47.545006 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-27cc78ac-fb09-4eba-b2bf-3e4289f571ba tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1317 microversion: 2.1 time: 0.084529 Oct 19 00:42:47.545677 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 192/427] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:47 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1317 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:47.965818 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-6e5f3df6-a851-429a-896f-db311c06d6cc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:47.975150 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-6e5f3df6-a851-429a-896f-db311c06d6cc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7" status: 200 len: 1367 microversion: 2.1 time: 0.501509 Oct 19 00:42:47.987902 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 236/428] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:47 2022] GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 => generated 1367 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:42:48.446496 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-0472b82e-3c0d-4d86-8c4e-d55022bc63b4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:48.447420 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-0472b82e-3c0d-4d86-8c4e-d55022bc63b4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:48.459781 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0472b82e-3c0d-4d86-8c4e-d55022bc63b4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:48.460646 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0472b82e-3c0d-4d86-8c4e-d55022bc63b4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:48.460897 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0472b82e-3c0d-4d86-8c4e-d55022bc63b4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:48.461676 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0472b82e-3c0d-4d86-8c4e-d55022bc63b4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:48.462176 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0472b82e-3c0d-4d86-8c4e-d55022bc63b4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:48.462599 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0472b82e-3c0d-4d86-8c4e-d55022bc63b4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:48.574046 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-d5871f35-d6db-4ab7-8580-6d816625bb4a tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:48.575563 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-d5871f35-d6db-4ab7-8580-6d816625bb4a tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:48.578252 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell0:SELECT=6 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:48.585753 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d5871f35-d6db-4ab7-8580-6d816625bb4a tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:48.586495 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d5871f35-d6db-4ab7-8580-6d816625bb4a tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:48.587198 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d5871f35-d6db-4ab7-8580-6d816625bb4a tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:48.588189 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d5871f35-d6db-4ab7-8580-6d816625bb4a tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:48.588805 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d5871f35-d6db-4ab7-8580-6d816625bb4a tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:48.589607 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d5871f35-d6db-4ab7-8580-6d816625bb4a tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:48.691669 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-0472b82e-3c0d-4d86-8c4e-d55022bc63b4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:48.702415 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-0472b82e-3c0d-4d86-8c4e-d55022bc63b4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:48.708333 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-0472b82e-3c0d-4d86-8c4e-d55022bc63b4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:48.710899 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-0472b82e-3c0d-4d86-8c4e-d55022bc63b4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1743 microversion: 2.20 time: 0.268543 Oct 19 00:42:48.723935 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 193/429] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:42:48 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1743 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:42:48.794094 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-d5871f35-d6db-4ab7-8580-6d816625bb4a tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:48.801719 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-d5871f35-d6db-4ab7-8580-6d816625bb4a tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1359 microversion: 2.1 time: 0.236499 Oct 19 00:42:48.802333 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 237/430] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:48 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1359 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:42:48.895533 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-ca4b0c40-01ed-42cf-8fda-ab16cca85198 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:42:48.902363 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ca4b0c40-01ed-42cf-8fda-ab16cca85198 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:48.902850 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ca4b0c40-01ed-42cf-8fda-ab16cca85198 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:48.903288 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ca4b0c40-01ed-42cf-8fda-ab16cca85198 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:48.965589 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-ca4b0c40-01ed-42cf-8fda-ab16cca85198 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Going to try to stop instance {{(pid=125531) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 19 00:42:48.999894 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-0fd5b4b9-52fa-4dc7-80d0-ccfad11fb7f5 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:49.000949 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-0fd5b4b9-52fa-4dc7-80d0-ccfad11fb7f5 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:49.008164 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0fd5b4b9-52fa-4dc7-80d0-ccfad11fb7f5 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:49.008649 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0fd5b4b9-52fa-4dc7-80d0-ccfad11fb7f5 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:49.009092 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0fd5b4b9-52fa-4dc7-80d0-ccfad11fb7f5 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:49.009772 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0fd5b4b9-52fa-4dc7-80d0-ccfad11fb7f5 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:49.010396 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0fd5b4b9-52fa-4dc7-80d0-ccfad11fb7f5 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:49.011303 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0fd5b4b9-52fa-4dc7-80d0-ccfad11fb7f5 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:49.023665 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-ca4b0c40-01ed-42cf-8fda-ab16cca85198 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "POST /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654/action" status: 202 len: 0 microversion: 2.1 time: 0.131819 Oct 19 00:42:49.024615 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 194/431] 10.222.0.33 () {60 vars in 1278 bytes} [Wed Oct 19 00:42:48 2022] POST /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:42:49.034758 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-7e61fe6d-1d12-44be-9f3f-bf6e497e58e1 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:49.036378 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-7e61fe6d-1d12-44be-9f3f-bf6e497e58e1 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:49.043969 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7e61fe6d-1d12-44be-9f3f-bf6e497e58e1 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:49.044691 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7e61fe6d-1d12-44be-9f3f-bf6e497e58e1 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:49.045549 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7e61fe6d-1d12-44be-9f3f-bf6e497e58e1 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:49.046568 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7e61fe6d-1d12-44be-9f3f-bf6e497e58e1 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:49.047461 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7e61fe6d-1d12-44be-9f3f-bf6e497e58e1 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:49.048206 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7e61fe6d-1d12-44be-9f3f-bf6e497e58e1 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:49.166619 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-0fd5b4b9-52fa-4dc7-80d0-ccfad11fb7f5 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:49.175769 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-0fd5b4b9-52fa-4dc7-80d0-ccfad11fb7f5 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7" status: 200 len: 1367 microversion: 2.1 time: 0.180689 Oct 19 00:42:49.177167 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 238/432] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:48 2022] GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:49.195557 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-7e61fe6d-1d12-44be-9f3f-bf6e497e58e1 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:49.204057 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-7e61fe6d-1d12-44be-9f3f-bf6e497e58e1 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1725 microversion: 2.1 time: 0.174234 Oct 19 00:42:49.204763 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 195/433] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:49 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:49.343674 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-040e891a-1b89-469f-9161-459eb8d8920d req-c7d3600f-b66c-44c9-8d25-899a4fe03d93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c74fb45-ef8a-4a88-8126-21c8266fddb2", "name": "network-vif-plugged", "status": "completed", "tag": "7926b647-0ec9-46fb-9fed-f33f2ff9fbcf"}]} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:42:49.356013 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-040e891a-1b89-469f-9161-459eb8d8920d req-c7d3600f-b66c-44c9-8d25-899a4fe03d93 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:49.356733 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-040e891a-1b89-469f-9161-459eb8d8920d req-c7d3600f-b66c-44c9-8d25-899a4fe03d93 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:49.358756 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-040e891a-1b89-469f-9161-459eb8d8920d req-c7d3600f-b66c-44c9-8d25-899a4fe03d93 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:49.372591 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.compute.server_external_events [req-040e891a-1b89-469f-9161-459eb8d8920d req-c7d3600f-b66c-44c9-8d25-899a4fe03d93 service nova] Creating event network-vif-plugged:7926b647-0ec9-46fb-9fed-f33f2ff9fbcf for instance 1c74fb45-ef8a-4a88-8126-21c8266fddb2 on hv-cinder-maste Oct 19 00:42:49.377808 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-040e891a-1b89-469f-9161-459eb8d8920d req-c7d3600f-b66c-44c9-8d25-899a4fe03d93 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038061 Oct 19 00:42:49.378409 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 239/434] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:42:49.737200 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-07831752-41e3-40c2-b9c9-4e68e03cf508 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:49.737781 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-07831752-41e3-40c2-b9c9-4e68e03cf508 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:49.746526 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-07831752-41e3-40c2-b9c9-4e68e03cf508 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:49.747116 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-07831752-41e3-40c2-b9c9-4e68e03cf508 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:49.747620 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-07831752-41e3-40c2-b9c9-4e68e03cf508 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:49.748417 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-07831752-41e3-40c2-b9c9-4e68e03cf508 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:49.749038 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-07831752-41e3-40c2-b9c9-4e68e03cf508 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:49.749696 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-07831752-41e3-40c2-b9c9-4e68e03cf508 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:49.825503 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-ddfb5fb3-978f-42bb-969f-c3ea24269338 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:49.826211 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-ddfb5fb3-978f-42bb-969f-c3ea24269338 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:49.832527 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ddfb5fb3-978f-42bb-969f-c3ea24269338 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:49.833029 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ddfb5fb3-978f-42bb-969f-c3ea24269338 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:49.833470 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ddfb5fb3-978f-42bb-969f-c3ea24269338 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:49.834185 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ddfb5fb3-978f-42bb-969f-c3ea24269338 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:49.834816 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ddfb5fb3-978f-42bb-969f-c3ea24269338 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:49.835348 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ddfb5fb3-978f-42bb-969f-c3ea24269338 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:49.894230 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-07831752-41e3-40c2-b9c9-4e68e03cf508 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:49.903811 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-07831752-41e3-40c2-b9c9-4e68e03cf508 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:49.905282 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-07831752-41e3-40c2-b9c9-4e68e03cf508 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:49.906451 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-07831752-41e3-40c2-b9c9-4e68e03cf508 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1743 microversion: 2.20 time: 0.173542 Oct 19 00:42:49.907970 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 196/435] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:42:49 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1743 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:42:49.997549 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-ddfb5fb3-978f-42bb-969f-c3ea24269338 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:50.005893 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-ddfb5fb3-978f-42bb-969f-c3ea24269338 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1359 microversion: 2.1 time: 0.185035 Oct 19 00:42:50.006475 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 240/436] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:49 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:42:50.204927 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-29665d6b-df9c-4e0e-8bb6-de5453a1ef12 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:50.206254 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-29665d6b-df9c-4e0e-8bb6-de5453a1ef12 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:50.214642 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-29665d6b-df9c-4e0e-8bb6-de5453a1ef12 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:50.215126 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-29665d6b-df9c-4e0e-8bb6-de5453a1ef12 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:50.215561 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-29665d6b-df9c-4e0e-8bb6-de5453a1ef12 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:50.216316 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-29665d6b-df9c-4e0e-8bb6-de5453a1ef12 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:50.216767 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-29665d6b-df9c-4e0e-8bb6-de5453a1ef12 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:50.217190 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-29665d6b-df9c-4e0e-8bb6-de5453a1ef12 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:50.227739 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-1d7f5ebc-38eb-414a-8f7d-2029063810b4 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:50.228461 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-1d7f5ebc-38eb-414a-8f7d-2029063810b4 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:50.234663 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1d7f5ebc-38eb-414a-8f7d-2029063810b4 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:50.235222 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1d7f5ebc-38eb-414a-8f7d-2029063810b4 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:50.235660 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1d7f5ebc-38eb-414a-8f7d-2029063810b4 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:50.236394 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1d7f5ebc-38eb-414a-8f7d-2029063810b4 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:50.236855 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1d7f5ebc-38eb-414a-8f7d-2029063810b4 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:50.237530 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1d7f5ebc-38eb-414a-8f7d-2029063810b4 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:50.375323 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-29665d6b-df9c-4e0e-8bb6-de5453a1ef12 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:50.383211 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-29665d6b-df9c-4e0e-8bb6-de5453a1ef12 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7" status: 200 len: 1367 microversion: 2.1 time: 0.184484 Oct 19 00:42:50.383795 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 197/437] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:50 2022] GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:50.404588 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-1d7f5ebc-38eb-414a-8f7d-2029063810b4 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:50.413942 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-1d7f5ebc-38eb-414a-8f7d-2029063810b4 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1725 microversion: 2.1 time: 0.189908 Oct 19 00:42:50.414795 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 241/438] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:50 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:42:50.933607 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-9dd64c2f-0007-42db-8bd2-632a7cb8179d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:50.934997 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-9dd64c2f-0007-42db-8bd2-632a7cb8179d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:50.942039 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9dd64c2f-0007-42db-8bd2-632a7cb8179d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:50.942557 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9dd64c2f-0007-42db-8bd2-632a7cb8179d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:50.942989 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9dd64c2f-0007-42db-8bd2-632a7cb8179d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:50.943719 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9dd64c2f-0007-42db-8bd2-632a7cb8179d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:50.944197 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9dd64c2f-0007-42db-8bd2-632a7cb8179d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:50.944943 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9dd64c2f-0007-42db-8bd2-632a7cb8179d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:51.029216 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-fdf1457c-8085-40c2-9081-b2254acbfdcb tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:51.029838 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-fdf1457c-8085-40c2-9081-b2254acbfdcb tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:51.036495 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-fdf1457c-8085-40c2-9081-b2254acbfdcb tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:51.036984 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-fdf1457c-8085-40c2-9081-b2254acbfdcb tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:51.037415 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-fdf1457c-8085-40c2-9081-b2254acbfdcb tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:51.038920 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-fdf1457c-8085-40c2-9081-b2254acbfdcb tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:51.039537 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-fdf1457c-8085-40c2-9081-b2254acbfdcb tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:51.040163 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-fdf1457c-8085-40c2-9081-b2254acbfdcb tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:51.093047 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-9dd64c2f-0007-42db-8bd2-632a7cb8179d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:51.101861 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-9dd64c2f-0007-42db-8bd2-632a7cb8179d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:51.103312 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-9dd64c2f-0007-42db-8bd2-632a7cb8179d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:51.104726 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-9dd64c2f-0007-42db-8bd2-632a7cb8179d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1743 microversion: 2.20 time: 0.175990 Oct 19 00:42:51.105284 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 198/439] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:42:50 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1743 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:42:51.193888 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-fdf1457c-8085-40c2-9081-b2254acbfdcb tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:51.202012 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-fdf1457c-8085-40c2-9081-b2254acbfdcb tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1359 microversion: 2.1 time: 0.176576 Oct 19 00:42:51.202697 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 242/440] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:51 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:42:51.406319 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-51ff3e97-9b25-4120-9e56-a69b1dbd2af0 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:51.406918 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-51ff3e97-9b25-4120-9e56-a69b1dbd2af0 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:51.413297 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-51ff3e97-9b25-4120-9e56-a69b1dbd2af0 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:51.413772 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-51ff3e97-9b25-4120-9e56-a69b1dbd2af0 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:51.414244 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-51ff3e97-9b25-4120-9e56-a69b1dbd2af0 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:51.414898 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-51ff3e97-9b25-4120-9e56-a69b1dbd2af0 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:51.415377 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-51ff3e97-9b25-4120-9e56-a69b1dbd2af0 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:51.415777 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-51ff3e97-9b25-4120-9e56-a69b1dbd2af0 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:51.438003 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-b965dd8e-3526-43d0-ab58-68144759c528 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:51.438782 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-b965dd8e-3526-43d0-ab58-68144759c528 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:51.469363 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b965dd8e-3526-43d0-ab58-68144759c528 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:51.469946 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b965dd8e-3526-43d0-ab58-68144759c528 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:51.470380 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b965dd8e-3526-43d0-ab58-68144759c528 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:51.471098 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b965dd8e-3526-43d0-ab58-68144759c528 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:51.471544 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b965dd8e-3526-43d0-ab58-68144759c528 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:51.471992 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b965dd8e-3526-43d0-ab58-68144759c528 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:51.597275 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-51ff3e97-9b25-4120-9e56-a69b1dbd2af0 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:51.599895 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:51.609189 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-51ff3e97-9b25-4120-9e56-a69b1dbd2af0 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7" status: 200 len: 1367 microversion: 2.1 time: 0.206518 Oct 19 00:42:51.610046 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 199/441] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:51 2022] GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:51.657795 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-b965dd8e-3526-43d0-ab58-68144759c528 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:51.666989 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-b965dd8e-3526-43d0-ab58-68144759c528 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1725 microversion: 2.1 time: 0.232719 Oct 19 00:42:51.667735 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 243/442] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:51 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1725 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:42:52.130130 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-b4e6028d-0f45-487b-bccd-5cc90243a7fa tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:52.130847 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-b4e6028d-0f45-487b-bccd-5cc90243a7fa tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:52.133928 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell0:SELECT=12 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:52.140649 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b4e6028d-0f45-487b-bccd-5cc90243a7fa tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:52.141131 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b4e6028d-0f45-487b-bccd-5cc90243a7fa tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:52.141563 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b4e6028d-0f45-487b-bccd-5cc90243a7fa tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:52.142563 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b4e6028d-0f45-487b-bccd-5cc90243a7fa tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:52.143016 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b4e6028d-0f45-487b-bccd-5cc90243a7fa tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:52.143439 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b4e6028d-0f45-487b-bccd-5cc90243a7fa tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:52.225785 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-f9cdf410-eba6-4401-9094-35bf910f5cfb tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:52.227487 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-f9cdf410-eba6-4401-9094-35bf910f5cfb tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:52.230778 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell0:SELECT=12 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:52.236047 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f9cdf410-eba6-4401-9094-35bf910f5cfb tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:52.236530 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f9cdf410-eba6-4401-9094-35bf910f5cfb tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:52.237241 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f9cdf410-eba6-4401-9094-35bf910f5cfb tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:52.238136 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f9cdf410-eba6-4401-9094-35bf910f5cfb tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:52.238731 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f9cdf410-eba6-4401-9094-35bf910f5cfb tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:52.239314 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f9cdf410-eba6-4401-9094-35bf910f5cfb tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:52.288600 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-b4e6028d-0f45-487b-bccd-5cc90243a7fa tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:52.300808 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-b4e6028d-0f45-487b-bccd-5cc90243a7fa tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:52.302566 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-b4e6028d-0f45-487b-bccd-5cc90243a7fa tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:52.304456 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-b4e6028d-0f45-487b-bccd-5cc90243a7fa tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1743 microversion: 2.20 time: 0.178387 Oct 19 00:42:52.305946 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 200/443] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:42:52 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1743 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:42:52.398529 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-f9cdf410-eba6-4401-9094-35bf910f5cfb tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:52.407299 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-f9cdf410-eba6-4401-9094-35bf910f5cfb tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1359 microversion: 2.1 time: 0.185973 Oct 19 00:42:52.407924 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 244/444] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:52 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:52.633482 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-cb8af79f-c2e2-4fbd-beaf-61cf2cc0f60c tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:52.634104 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-cb8af79f-c2e2-4fbd-beaf-61cf2cc0f60c tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:52.640343 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cb8af79f-c2e2-4fbd-beaf-61cf2cc0f60c tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:52.640890 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cb8af79f-c2e2-4fbd-beaf-61cf2cc0f60c tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:52.641323 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cb8af79f-c2e2-4fbd-beaf-61cf2cc0f60c tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:52.642029 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cb8af79f-c2e2-4fbd-beaf-61cf2cc0f60c tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:52.642486 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cb8af79f-c2e2-4fbd-beaf-61cf2cc0f60c tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:52.642916 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cb8af79f-c2e2-4fbd-beaf-61cf2cc0f60c tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:52.692316 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-480b7521-f4fd-4403-8368-cd24138b6ce2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:52.692925 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-480b7521-f4fd-4403-8368-cd24138b6ce2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:52.713964 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-480b7521-f4fd-4403-8368-cd24138b6ce2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:52.713964 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-480b7521-f4fd-4403-8368-cd24138b6ce2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:52.713964 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-480b7521-f4fd-4403-8368-cd24138b6ce2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:52.713964 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-480b7521-f4fd-4403-8368-cd24138b6ce2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:52.728516 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-480b7521-f4fd-4403-8368-cd24138b6ce2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:52.728516 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-480b7521-f4fd-4403-8368-cd24138b6ce2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:52.854345 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-cb8af79f-c2e2-4fbd-beaf-61cf2cc0f60c tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:52.862805 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-cb8af79f-c2e2-4fbd-beaf-61cf2cc0f60c tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7" status: 200 len: 1367 microversion: 2.1 time: 0.233772 Oct 19 00:42:52.863981 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 201/445] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:52 2022] GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:52.889493 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-480b7521-f4fd-4403-8368-cd24138b6ce2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:52.897981 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-480b7521-f4fd-4403-8368-cd24138b6ce2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1725 microversion: 2.1 time: 0.211023 Oct 19 00:42:52.898562 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 245/446] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:52 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1725 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:53.331236 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-877c1c9a-09ff-4905-8dc2-0643ea6bfa2e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:53.332156 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-877c1c9a-09ff-4905-8dc2-0643ea6bfa2e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:53.339576 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-877c1c9a-09ff-4905-8dc2-0643ea6bfa2e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:53.340099 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-877c1c9a-09ff-4905-8dc2-0643ea6bfa2e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:53.340533 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-877c1c9a-09ff-4905-8dc2-0643ea6bfa2e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:53.341266 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-877c1c9a-09ff-4905-8dc2-0643ea6bfa2e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:53.341711 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-877c1c9a-09ff-4905-8dc2-0643ea6bfa2e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:53.342334 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-877c1c9a-09ff-4905-8dc2-0643ea6bfa2e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:53.432965 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-8f8cec71-9883-4176-bc31-7ae6c1d4323a tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:53.433704 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-8f8cec71-9883-4176-bc31-7ae6c1d4323a tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:53.440454 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8f8cec71-9883-4176-bc31-7ae6c1d4323a tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:53.440951 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8f8cec71-9883-4176-bc31-7ae6c1d4323a tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:53.441394 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8f8cec71-9883-4176-bc31-7ae6c1d4323a tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:53.442130 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8f8cec71-9883-4176-bc31-7ae6c1d4323a tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:53.442760 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8f8cec71-9883-4176-bc31-7ae6c1d4323a tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:53.443191 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8f8cec71-9883-4176-bc31-7ae6c1d4323a tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:53.505426 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-877c1c9a-09ff-4905-8dc2-0643ea6bfa2e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:53.513692 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-877c1c9a-09ff-4905-8dc2-0643ea6bfa2e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:53.515474 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-877c1c9a-09ff-4905-8dc2-0643ea6bfa2e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:53.516799 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-877c1c9a-09ff-4905-8dc2-0643ea6bfa2e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1743 microversion: 2.20 time: 0.189808 Oct 19 00:42:53.517434 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 202/447] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:42:53 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1743 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:42:53.580789 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-8f8cec71-9883-4176-bc31-7ae6c1d4323a tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:53.589179 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-8f8cec71-9883-4176-bc31-7ae6c1d4323a tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1359 microversion: 2.1 time: 0.160859 Oct 19 00:42:53.589745 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 246/448] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:53 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:53.896268 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-bb984521-e898-422c-b123-1d97f697fee6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:53.897001 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-bb984521-e898-422c-b123-1d97f697fee6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:53.903813 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bb984521-e898-422c-b123-1d97f697fee6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:53.904327 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bb984521-e898-422c-b123-1d97f697fee6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:53.904757 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bb984521-e898-422c-b123-1d97f697fee6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:53.905449 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bb984521-e898-422c-b123-1d97f697fee6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:53.905894 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bb984521-e898-422c-b123-1d97f697fee6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:53.906310 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bb984521-e898-422c-b123-1d97f697fee6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:53.924260 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-116aa891-259d-4dd4-81ec-d07f5019d32a tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:53.925012 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-116aa891-259d-4dd4-81ec-d07f5019d32a tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:53.926970 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:53.932287 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-116aa891-259d-4dd4-81ec-d07f5019d32a tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:53.932869 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-116aa891-259d-4dd4-81ec-d07f5019d32a tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:53.933382 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-116aa891-259d-4dd4-81ec-d07f5019d32a tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:53.934456 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-116aa891-259d-4dd4-81ec-d07f5019d32a tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:53.934988 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-116aa891-259d-4dd4-81ec-d07f5019d32a tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:53.935482 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-116aa891-259d-4dd4-81ec-d07f5019d32a tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:54.049864 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-bb984521-e898-422c-b123-1d97f697fee6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:54.060324 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-bb984521-e898-422c-b123-1d97f697fee6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7" status: 200 len: 1367 microversion: 2.1 time: 0.175813 Oct 19 00:42:54.061128 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 203/449] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:53 2022] GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:42:54.124976 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-116aa891-259d-4dd4-81ec-d07f5019d32a tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:54.134745 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-116aa891-259d-4dd4-81ec-d07f5019d32a tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1725 microversion: 2.1 time: 0.215039 Oct 19 00:42:54.135315 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 247/450] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:53 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:54.543336 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-4ba68efe-a6aa-4ac8-97df-afe31eead9cf tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:54.543969 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-4ba68efe-a6aa-4ac8-97df-afe31eead9cf tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:54.550710 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4ba68efe-a6aa-4ac8-97df-afe31eead9cf tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:54.551190 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4ba68efe-a6aa-4ac8-97df-afe31eead9cf tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:54.551622 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4ba68efe-a6aa-4ac8-97df-afe31eead9cf tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:54.552350 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4ba68efe-a6aa-4ac8-97df-afe31eead9cf tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:54.552804 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4ba68efe-a6aa-4ac8-97df-afe31eead9cf tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:54.553225 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4ba68efe-a6aa-4ac8-97df-afe31eead9cf tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:54.612571 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-78ccb0be-bbd2-40ba-b779-d173a2d532be tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:54.614297 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-78ccb0be-bbd2-40ba-b779-d173a2d532be tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:54.621624 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-78ccb0be-bbd2-40ba-b779-d173a2d532be tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:54.622179 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-78ccb0be-bbd2-40ba-b779-d173a2d532be tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:54.624474 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-78ccb0be-bbd2-40ba-b779-d173a2d532be tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:54.625282 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-78ccb0be-bbd2-40ba-b779-d173a2d532be tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:54.625998 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-78ccb0be-bbd2-40ba-b779-d173a2d532be tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:54.626628 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-78ccb0be-bbd2-40ba-b779-d173a2d532be tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:54.718205 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-4ba68efe-a6aa-4ac8-97df-afe31eead9cf tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:54.727808 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-4ba68efe-a6aa-4ac8-97df-afe31eead9cf tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:54.729418 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-4ba68efe-a6aa-4ac8-97df-afe31eead9cf tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:54.730612 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-4ba68efe-a6aa-4ac8-97df-afe31eead9cf tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1743 microversion: 2.20 time: 0.191271 Oct 19 00:42:54.731149 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 204/451] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:42:54 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1743 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:42:54.789145 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-78ccb0be-bbd2-40ba-b779-d173a2d532be tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:54.797061 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-78ccb0be-bbd2-40ba-b779-d173a2d532be tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1359 microversion: 2.1 time: 0.188693 Oct 19 00:42:54.797760 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 248/452] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:54 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:55.084348 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-e8cffe23-247d-4fc6-bdd1-aacab6f06592 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:55.085541 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-e8cffe23-247d-4fc6-bdd1-aacab6f06592 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:55.091811 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e8cffe23-247d-4fc6-bdd1-aacab6f06592 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:55.092365 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e8cffe23-247d-4fc6-bdd1-aacab6f06592 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:55.092902 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e8cffe23-247d-4fc6-bdd1-aacab6f06592 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:55.093619 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e8cffe23-247d-4fc6-bdd1-aacab6f06592 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:55.094076 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e8cffe23-247d-4fc6-bdd1-aacab6f06592 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:55.094500 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e8cffe23-247d-4fc6-bdd1-aacab6f06592 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:55.158712 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-aaf06ac6-5b95-4293-a896-b565335ecce5 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:55.159326 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-aaf06ac6-5b95-4293-a896-b565335ecce5 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:55.165921 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-aaf06ac6-5b95-4293-a896-b565335ecce5 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:55.166406 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-aaf06ac6-5b95-4293-a896-b565335ecce5 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:55.166840 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-aaf06ac6-5b95-4293-a896-b565335ecce5 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:55.167545 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-aaf06ac6-5b95-4293-a896-b565335ecce5 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:55.168038 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-aaf06ac6-5b95-4293-a896-b565335ecce5 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:55.168553 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-aaf06ac6-5b95-4293-a896-b565335ecce5 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:55.172801 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell1:SELECT=100 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:55.242379 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-e8cffe23-247d-4fc6-bdd1-aacab6f06592 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:55.250542 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-e8cffe23-247d-4fc6-bdd1-aacab6f06592 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7" status: 200 len: 1367 microversion: 2.1 time: 0.170086 Oct 19 00:42:55.255489 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 205/453] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:55 2022] GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:55.318704 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-aaf06ac6-5b95-4293-a896-b565335ecce5 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:55.325982 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-aaf06ac6-5b95-4293-a896-b565335ecce5 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1725 microversion: 2.1 time: 0.171125 Oct 19 00:42:55.326546 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 249/454] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:55 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:55.755805 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-57db5246-aa4f-4e34-a729-038debd63874 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:55.757137 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-57db5246-aa4f-4e34-a729-038debd63874 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:55.759452 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell0:SELECT=6 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:55.766512 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-57db5246-aa4f-4e34-a729-038debd63874 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:55.768419 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-57db5246-aa4f-4e34-a729-038debd63874 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:55.768882 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-57db5246-aa4f-4e34-a729-038debd63874 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:55.769612 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-57db5246-aa4f-4e34-a729-038debd63874 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:55.770066 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-57db5246-aa4f-4e34-a729-038debd63874 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:55.770493 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-57db5246-aa4f-4e34-a729-038debd63874 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:55.820670 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-22402f16-06ca-4cdd-87ec-e35208cd4b27 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:55.821332 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-22402f16-06ca-4cdd-87ec-e35208cd4b27 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:55.827979 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-22402f16-06ca-4cdd-87ec-e35208cd4b27 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:55.828469 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-22402f16-06ca-4cdd-87ec-e35208cd4b27 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:55.828900 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-22402f16-06ca-4cdd-87ec-e35208cd4b27 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:55.829771 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-22402f16-06ca-4cdd-87ec-e35208cd4b27 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:55.830220 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-22402f16-06ca-4cdd-87ec-e35208cd4b27 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:55.830881 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-22402f16-06ca-4cdd-87ec-e35208cd4b27 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:55.935255 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-57db5246-aa4f-4e34-a729-038debd63874 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:55.944822 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-57db5246-aa4f-4e34-a729-038debd63874 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:55.946524 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-57db5246-aa4f-4e34-a729-038debd63874 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:55.947761 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-57db5246-aa4f-4e34-a729-038debd63874 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1743 microversion: 2.20 time: 0.195833 Oct 19 00:42:55.948444 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 206/455] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:42:55 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1743 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:42:55.974720 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-22402f16-06ca-4cdd-87ec-e35208cd4b27 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:55.983412 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-22402f16-06ca-4cdd-87ec-e35208cd4b27 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1359 microversion: 2.1 time: 0.167533 Oct 19 00:42:55.984016 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 250/456] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:55 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:42:56.275118 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-492915a1-7749-457d-a35e-4fd4d9e57523 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:56.275647 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-492915a1-7749-457d-a35e-4fd4d9e57523 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:56.282060 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-492915a1-7749-457d-a35e-4fd4d9e57523 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:56.282545 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-492915a1-7749-457d-a35e-4fd4d9e57523 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:56.282979 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-492915a1-7749-457d-a35e-4fd4d9e57523 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:56.283726 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-492915a1-7749-457d-a35e-4fd4d9e57523 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:56.284151 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-492915a1-7749-457d-a35e-4fd4d9e57523 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:56.284573 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-492915a1-7749-457d-a35e-4fd4d9e57523 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:56.350070 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-0556ff29-763a-4a99-bb37-bcd91b265894 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:56.351972 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-0556ff29-763a-4a99-bb37-bcd91b265894 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:56.358956 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0556ff29-763a-4a99-bb37-bcd91b265894 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:56.359422 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0556ff29-763a-4a99-bb37-bcd91b265894 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:56.360075 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0556ff29-763a-4a99-bb37-bcd91b265894 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:56.372943 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0556ff29-763a-4a99-bb37-bcd91b265894 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:56.373626 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0556ff29-763a-4a99-bb37-bcd91b265894 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:56.373865 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0556ff29-763a-4a99-bb37-bcd91b265894 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:56.436435 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-492915a1-7749-457d-a35e-4fd4d9e57523 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:56.446156 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-492915a1-7749-457d-a35e-4fd4d9e57523 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7" status: 200 len: 1367 microversion: 2.1 time: 0.175494 Oct 19 00:42:56.446980 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 207/457] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:56 2022] GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:56.529563 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-0556ff29-763a-4a99-bb37-bcd91b265894 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:56.538529 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-0556ff29-763a-4a99-bb37-bcd91b265894 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1725 microversion: 2.1 time: 0.191780 Oct 19 00:42:56.539124 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 251/458] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:56 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1725 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:42:56.973887 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-a347e6c5-053c-4d89-b6ed-9527cd91304f tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:56.976129 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-a347e6c5-053c-4d89-b6ed-9527cd91304f tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:56.982774 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a347e6c5-053c-4d89-b6ed-9527cd91304f tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:56.983265 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a347e6c5-053c-4d89-b6ed-9527cd91304f tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:56.983698 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a347e6c5-053c-4d89-b6ed-9527cd91304f tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:56.984431 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a347e6c5-053c-4d89-b6ed-9527cd91304f tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:56.984912 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a347e6c5-053c-4d89-b6ed-9527cd91304f tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:56.985365 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a347e6c5-053c-4d89-b6ed-9527cd91304f tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:57.006741 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-39a13da6-f06d-485d-8965-8849a6e8b2b0 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:57.007512 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-39a13da6-f06d-485d-8965-8849a6e8b2b0 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:57.014188 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-39a13da6-f06d-485d-8965-8849a6e8b2b0 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:57.014677 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-39a13da6-f06d-485d-8965-8849a6e8b2b0 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:57.015227 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-39a13da6-f06d-485d-8965-8849a6e8b2b0 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:57.015987 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-39a13da6-f06d-485d-8965-8849a6e8b2b0 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:57.016437 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-39a13da6-f06d-485d-8965-8849a6e8b2b0 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:57.016855 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-39a13da6-f06d-485d-8965-8849a6e8b2b0 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:57.121217 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-a347e6c5-053c-4d89-b6ed-9527cd91304f tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:57.130620 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-a347e6c5-053c-4d89-b6ed-9527cd91304f tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:57.132652 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-a347e6c5-053c-4d89-b6ed-9527cd91304f tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:57.133891 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-a347e6c5-053c-4d89-b6ed-9527cd91304f tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1743 microversion: 2.20 time: 0.163945 Oct 19 00:42:57.144163 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 208/459] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:42:56 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1743 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:42:57.166340 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-39a13da6-f06d-485d-8965-8849a6e8b2b0 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:57.174791 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-39a13da6-f06d-485d-8965-8849a6e8b2b0 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1359 microversion: 2.1 time: 0.172052 Oct 19 00:42:57.175376 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 252/460] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:57 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:57.469211 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-ead24fa2-2d13-49d2-a26d-6495adc5b209 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:57.469822 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-ead24fa2-2d13-49d2-a26d-6495adc5b209 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:57.475816 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ead24fa2-2d13-49d2-a26d-6495adc5b209 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:57.476338 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ead24fa2-2d13-49d2-a26d-6495adc5b209 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:57.476770 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ead24fa2-2d13-49d2-a26d-6495adc5b209 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:57.477471 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ead24fa2-2d13-49d2-a26d-6495adc5b209 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:57.477919 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ead24fa2-2d13-49d2-a26d-6495adc5b209 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:57.478343 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ead24fa2-2d13-49d2-a26d-6495adc5b209 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:57.562769 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-d3516b77-e2c9-46cc-af3e-a5769342bcad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:57.563876 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-d3516b77-e2c9-46cc-af3e-a5769342bcad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:57.571688 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d3516b77-e2c9-46cc-af3e-a5769342bcad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:57.572204 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d3516b77-e2c9-46cc-af3e-a5769342bcad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:57.572647 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d3516b77-e2c9-46cc-af3e-a5769342bcad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:57.573407 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d3516b77-e2c9-46cc-af3e-a5769342bcad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:57.573861 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d3516b77-e2c9-46cc-af3e-a5769342bcad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:57.574285 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d3516b77-e2c9-46cc-af3e-a5769342bcad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:57.618188 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-ead24fa2-2d13-49d2-a26d-6495adc5b209 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:57.627287 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-ead24fa2-2d13-49d2-a26d-6495adc5b209 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7" status: 200 len: 1367 microversion: 2.1 time: 0.161913 Oct 19 00:42:57.628012 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 209/461] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:57 2022] GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:57.735253 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-d3516b77-e2c9-46cc-af3e-a5769342bcad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:57.747882 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-d3516b77-e2c9-46cc-af3e-a5769342bcad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1725 microversion: 2.1 time: 0.189162 Oct 19 00:42:57.748648 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 253/462] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:57 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:58.158749 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-c997d7cf-8528-45da-8935-f2dc90d77502 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:58.159347 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-c997d7cf-8528-45da-8935-f2dc90d77502 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:58.165836 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c997d7cf-8528-45da-8935-f2dc90d77502 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:58.166319 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c997d7cf-8528-45da-8935-f2dc90d77502 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:58.166759 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c997d7cf-8528-45da-8935-f2dc90d77502 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:58.167443 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c997d7cf-8528-45da-8935-f2dc90d77502 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:58.167913 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c997d7cf-8528-45da-8935-f2dc90d77502 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:58.168337 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c997d7cf-8528-45da-8935-f2dc90d77502 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:58.198005 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-456c5db3-674e-4a50-a073-455005a4f540 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:58.198612 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-456c5db3-674e-4a50-a073-455005a4f540 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:58.204534 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-456c5db3-674e-4a50-a073-455005a4f540 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:58.205009 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-456c5db3-674e-4a50-a073-455005a4f540 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:58.205440 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-456c5db3-674e-4a50-a073-455005a4f540 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:58.206117 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-456c5db3-674e-4a50-a073-455005a4f540 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:58.206564 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-456c5db3-674e-4a50-a073-455005a4f540 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:58.206979 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-456c5db3-674e-4a50-a073-455005a4f540 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:58.312150 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-c997d7cf-8528-45da-8935-f2dc90d77502 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:58.320345 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-c997d7cf-8528-45da-8935-f2dc90d77502 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:58.321797 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-c997d7cf-8528-45da-8935-f2dc90d77502 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:58.322957 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-c997d7cf-8528-45da-8935-f2dc90d77502 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1743 microversion: 2.20 time: 0.168241 Oct 19 00:42:58.323514 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 210/463] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:42:58 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1743 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:42:58.345154 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-456c5db3-674e-4a50-a073-455005a4f540 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:58.359594 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-456c5db3-674e-4a50-a073-455005a4f540 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1359 microversion: 2.1 time: 0.165915 Oct 19 00:42:58.360212 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 254/464] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:58 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:42:58.653966 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-06bb1642-4052-4c54-bbf2-8806fe75fa64 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:58.654629 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-06bb1642-4052-4c54-bbf2-8806fe75fa64 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:58.660700 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-06bb1642-4052-4c54-bbf2-8806fe75fa64 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:58.661402 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-06bb1642-4052-4c54-bbf2-8806fe75fa64 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:58.661852 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-06bb1642-4052-4c54-bbf2-8806fe75fa64 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:58.662602 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-06bb1642-4052-4c54-bbf2-8806fe75fa64 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:58.663392 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-06bb1642-4052-4c54-bbf2-8806fe75fa64 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:58.663985 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-06bb1642-4052-4c54-bbf2-8806fe75fa64 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:58.770899 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-6ff6a162-23c8-4f2f-8380-a9bd4f10945c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:58.772066 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-6ff6a162-23c8-4f2f-8380-a9bd4f10945c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:58.778507 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6ff6a162-23c8-4f2f-8380-a9bd4f10945c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:58.779021 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6ff6a162-23c8-4f2f-8380-a9bd4f10945c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:58.780113 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6ff6a162-23c8-4f2f-8380-a9bd4f10945c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:58.780410 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6ff6a162-23c8-4f2f-8380-a9bd4f10945c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:58.780880 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6ff6a162-23c8-4f2f-8380-a9bd4f10945c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:58.781307 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6ff6a162-23c8-4f2f-8380-a9bd4f10945c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:58.797582 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-06bb1642-4052-4c54-bbf2-8806fe75fa64 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:58.805301 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-06bb1642-4052-4c54-bbf2-8806fe75fa64 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7" status: 200 len: 1367 microversion: 2.1 time: 0.155222 Oct 19 00:42:58.805858 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 211/465] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:58 2022] GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:42:58.908809 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-6ff6a162-23c8-4f2f-8380-a9bd4f10945c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:58.917086 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-6ff6a162-23c8-4f2f-8380-a9bd4f10945c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1725 microversion: 2.1 time: 0.150497 Oct 19 00:42:58.917658 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 255/466] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:58 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:42:59.349022 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-8248d6c0-5305-4da3-8bb0-e4af9f10353b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:59.349623 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-8248d6c0-5305-4da3-8bb0-e4af9f10353b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:59.356006 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8248d6c0-5305-4da3-8bb0-e4af9f10353b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:59.356477 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8248d6c0-5305-4da3-8bb0-e4af9f10353b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:59.356905 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8248d6c0-5305-4da3-8bb0-e4af9f10353b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:59.357582 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8248d6c0-5305-4da3-8bb0-e4af9f10353b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:59.358025 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8248d6c0-5305-4da3-8bb0-e4af9f10353b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:59.358441 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8248d6c0-5305-4da3-8bb0-e4af9f10353b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:59.383089 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-2282159f-b87a-4bb3-a525-5c76d8f87087 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:59.383826 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-2282159f-b87a-4bb3-a525-5c76d8f87087 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:59.389775 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2282159f-b87a-4bb3-a525-5c76d8f87087 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:59.390250 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2282159f-b87a-4bb3-a525-5c76d8f87087 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:59.390682 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2282159f-b87a-4bb3-a525-5c76d8f87087 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:59.391380 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2282159f-b87a-4bb3-a525-5c76d8f87087 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:59.391830 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2282159f-b87a-4bb3-a525-5c76d8f87087 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:59.392276 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2282159f-b87a-4bb3-a525-5c76d8f87087 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:59.492728 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-8248d6c0-5305-4da3-8bb0-e4af9f10353b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:59.501020 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-8248d6c0-5305-4da3-8bb0-e4af9f10353b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:59.502552 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-8248d6c0-5305-4da3-8bb0-e4af9f10353b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:59.503813 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-8248d6c0-5305-4da3-8bb0-e4af9f10353b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1743 microversion: 2.20 time: 0.158706 Oct 19 00:42:59.504480 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 212/467] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:42:59 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:42:59.521835 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-2282159f-b87a-4bb3-a525-5c76d8f87087 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:59.530069 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-2282159f-b87a-4bb3-a525-5c76d8f87087 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1359 microversion: 2.1 time: 0.151691 Oct 19 00:42:59.530665 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 256/468] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:59 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:42:59.828116 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-88159b55-181b-42da-a8dd-a64147c919d7 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:59.828725 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-88159b55-181b-42da-a8dd-a64147c919d7 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:59.835299 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-88159b55-181b-42da-a8dd-a64147c919d7 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:59.835745 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-88159b55-181b-42da-a8dd-a64147c919d7 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:59.836211 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-88159b55-181b-42da-a8dd-a64147c919d7 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:59.836938 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-88159b55-181b-42da-a8dd-a64147c919d7 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:59.837390 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-88159b55-181b-42da-a8dd-a64147c919d7 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:59.837810 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-88159b55-181b-42da-a8dd-a64147c919d7 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:59.940272 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-89d34bf1-aff3-4970-9dd5-8acac891bce2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:59.940973 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-89d34bf1-aff3-4970-9dd5-8acac891bce2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:42:59.947817 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-89d34bf1-aff3-4970-9dd5-8acac891bce2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:59.948327 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-89d34bf1-aff3-4970-9dd5-8acac891bce2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:59.948754 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-89d34bf1-aff3-4970-9dd5-8acac891bce2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:59.949437 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-89d34bf1-aff3-4970-9dd5-8acac891bce2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:59.949886 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-89d34bf1-aff3-4970-9dd5-8acac891bce2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:59.950303 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-89d34bf1-aff3-4970-9dd5-8acac891bce2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:59.972953 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-88159b55-181b-42da-a8dd-a64147c919d7 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:42:59.983190 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-88159b55-181b-42da-a8dd-a64147c919d7 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7" status: 200 len: 1367 microversion: 2.1 time: 0.158777 Oct 19 00:42:59.983703 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 213/469] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:59 2022] GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:00.084390 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-89d34bf1-aff3-4970-9dd5-8acac891bce2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:00.093137 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-89d34bf1-aff3-4970-9dd5-8acac891bce2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1725 microversion: 2.1 time: 0.156688 Oct 19 00:43:00.093693 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 257/470] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:42:59 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:43:00.529168 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-ce8dbc91-b63e-4e52-98aa-93159667d3e5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:00.529782 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-ce8dbc91-b63e-4e52-98aa-93159667d3e5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:00.537385 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ce8dbc91-b63e-4e52-98aa-93159667d3e5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:00.537973 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ce8dbc91-b63e-4e52-98aa-93159667d3e5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:00.538496 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ce8dbc91-b63e-4e52-98aa-93159667d3e5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:00.539304 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ce8dbc91-b63e-4e52-98aa-93159667d3e5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:00.539763 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ce8dbc91-b63e-4e52-98aa-93159667d3e5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:00.540215 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ce8dbc91-b63e-4e52-98aa-93159667d3e5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:00.554025 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-08cebde1-c130-40e1-8208-db72d7eb97d0 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:00.555398 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-08cebde1-c130-40e1-8208-db72d7eb97d0 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:00.561584 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-08cebde1-c130-40e1-8208-db72d7eb97d0 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:00.562012 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-08cebde1-c130-40e1-8208-db72d7eb97d0 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:00.562661 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-08cebde1-c130-40e1-8208-db72d7eb97d0 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:00.563663 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-08cebde1-c130-40e1-8208-db72d7eb97d0 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:00.564162 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-08cebde1-c130-40e1-8208-db72d7eb97d0 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:00.564750 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-08cebde1-c130-40e1-8208-db72d7eb97d0 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:00.683660 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-ce8dbc91-b63e-4e52-98aa-93159667d3e5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:00.692569 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-ce8dbc91-b63e-4e52-98aa-93159667d3e5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:00.695080 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-ce8dbc91-b63e-4e52-98aa-93159667d3e5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:00.699054 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-ce8dbc91-b63e-4e52-98aa-93159667d3e5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1743 microversion: 2.20 time: 0.172918 Oct 19 00:43:00.702906 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 214/471] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:00 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1743 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:00.773709 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-08cebde1-c130-40e1-8208-db72d7eb97d0 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:00.781517 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-08cebde1-c130-40e1-8208-db72d7eb97d0 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1359 microversion: 2.1 time: 0.231725 Oct 19 00:43:00.782094 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 258/472] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:00 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1359 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:01.006059 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-0a02b205-ba94-43e9-902f-7eb9a5880872 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:01.006834 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-0a02b205-ba94-43e9-902f-7eb9a5880872 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:01.012796 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0a02b205-ba94-43e9-902f-7eb9a5880872 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:01.013282 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0a02b205-ba94-43e9-902f-7eb9a5880872 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:01.013770 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0a02b205-ba94-43e9-902f-7eb9a5880872 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:01.014546 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0a02b205-ba94-43e9-902f-7eb9a5880872 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:01.015074 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0a02b205-ba94-43e9-902f-7eb9a5880872 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:01.015502 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0a02b205-ba94-43e9-902f-7eb9a5880872 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:01.117219 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-dcc430b1-3e88-4398-98d4-74fab35a1bb3 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:01.117835 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-dcc430b1-3e88-4398-98d4-74fab35a1bb3 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:01.124368 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dcc430b1-3e88-4398-98d4-74fab35a1bb3 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:01.124985 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dcc430b1-3e88-4398-98d4-74fab35a1bb3 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:01.125428 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dcc430b1-3e88-4398-98d4-74fab35a1bb3 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:01.126129 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dcc430b1-3e88-4398-98d4-74fab35a1bb3 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:01.126585 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dcc430b1-3e88-4398-98d4-74fab35a1bb3 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:01.127008 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dcc430b1-3e88-4398-98d4-74fab35a1bb3 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:01.148238 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-0a02b205-ba94-43e9-902f-7eb9a5880872 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:01.157252 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-0a02b205-ba94-43e9-902f-7eb9a5880872 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7" status: 200 len: 1367 microversion: 2.1 time: 0.155046 Oct 19 00:43:01.160347 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 215/473] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:01 2022] GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:01.219255 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-6c36b948-ce40-4dcb-ac35-78f95e15388c req-97e94ca3-2ab0-4519-92cb-aae056a58add service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09190732-7307-4684-a264-9b5b31301df4", "tag": "c199c72b-1e56-47e2-b8a5-93c07ba36102"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:43:01.229595 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-6c36b948-ce40-4dcb-ac35-78f95e15388c req-97e94ca3-2ab0-4519-92cb-aae056a58add service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:01.230064 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-6c36b948-ce40-4dcb-ac35-78f95e15388c req-97e94ca3-2ab0-4519-92cb-aae056a58add service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:01.230485 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-6c36b948-ce40-4dcb-ac35-78f95e15388c req-97e94ca3-2ab0-4519-92cb-aae056a58add service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:01.242960 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-6c36b948-ce40-4dcb-ac35-78f95e15388c req-97e94ca3-2ab0-4519-92cb-aae056a58add service nova] Creating event network-changed:c199c72b-1e56-47e2-b8a5-93c07ba36102 for instance 09190732-7307-4684-a264-9b5b31301df4 on hv-cinder-maste Oct 19 00:43:01.248097 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-6c36b948-ce40-4dcb-ac35-78f95e15388c req-97e94ca3-2ab0-4519-92cb-aae056a58add service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032597 Oct 19 00:43:01.248915 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 216/474] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:43:01.307020 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-dcc430b1-3e88-4398-98d4-74fab35a1bb3 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:01.315134 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-dcc430b1-3e88-4398-98d4-74fab35a1bb3 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1725 microversion: 2.1 time: 0.202907 Oct 19 00:43:01.315685 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 259/475] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:01 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1725 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:43:01.725852 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-debfc63e-082f-4766-8942-947fc272ac57 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:01.726550 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-debfc63e-082f-4766-8942-947fc272ac57 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:01.732683 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-debfc63e-082f-4766-8942-947fc272ac57 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:01.733163 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-debfc63e-082f-4766-8942-947fc272ac57 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:01.733596 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-debfc63e-082f-4766-8942-947fc272ac57 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:01.734281 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-debfc63e-082f-4766-8942-947fc272ac57 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:01.734732 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-debfc63e-082f-4766-8942-947fc272ac57 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:01.735150 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-debfc63e-082f-4766-8942-947fc272ac57 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:01.738088 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell1:SELECT=100 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:01.804136 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-e9c706f7-3b93-4501-824b-c6b90f81009b tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:01.804768 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-e9c706f7-3b93-4501-824b-c6b90f81009b tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:01.810659 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e9c706f7-3b93-4501-824b-c6b90f81009b tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:01.811143 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e9c706f7-3b93-4501-824b-c6b90f81009b tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:01.811596 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e9c706f7-3b93-4501-824b-c6b90f81009b tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:01.812306 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e9c706f7-3b93-4501-824b-c6b90f81009b tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:01.812769 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e9c706f7-3b93-4501-824b-c6b90f81009b tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:01.813309 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e9c706f7-3b93-4501-824b-c6b90f81009b tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:01.866210 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-debfc63e-082f-4766-8942-947fc272ac57 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:01.875786 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-debfc63e-082f-4766-8942-947fc272ac57 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:01.877234 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-debfc63e-082f-4766-8942-947fc272ac57 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:01.878396 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-debfc63e-082f-4766-8942-947fc272ac57 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1743 microversion: 2.20 time: 0.157372 Oct 19 00:43:01.878989 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 217/476] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:01 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:01.943588 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-e9c706f7-3b93-4501-824b-c6b90f81009b tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:01.952450 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-e9c706f7-3b93-4501-824b-c6b90f81009b tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1359 microversion: 2.1 time: 0.152266 Oct 19 00:43:01.953008 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 260/477] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:01 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:43:02.180341 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-71251b03-36ba-45d4-a7ba-5b6a5844a48b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:02.180870 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-71251b03-36ba-45d4-a7ba-5b6a5844a48b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:02.187370 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-71251b03-36ba-45d4-a7ba-5b6a5844a48b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:02.187828 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-71251b03-36ba-45d4-a7ba-5b6a5844a48b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:02.188395 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-71251b03-36ba-45d4-a7ba-5b6a5844a48b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:02.189126 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-71251b03-36ba-45d4-a7ba-5b6a5844a48b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:02.189597 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-71251b03-36ba-45d4-a7ba-5b6a5844a48b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:02.190035 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-71251b03-36ba-45d4-a7ba-5b6a5844a48b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:02.321876 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-71251b03-36ba-45d4-a7ba-5b6a5844a48b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:02.329788 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-71251b03-36ba-45d4-a7ba-5b6a5844a48b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7" status: 200 len: 1367 microversion: 2.1 time: 0.153471 Oct 19 00:43:02.330357 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 218/478] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:02 2022] GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:02.339752 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-b46e1b45-4354-4e8a-9a3f-eadfd807689f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:02.340395 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-b46e1b45-4354-4e8a-9a3f-eadfd807689f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:02.347578 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b46e1b45-4354-4e8a-9a3f-eadfd807689f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:02.348190 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b46e1b45-4354-4e8a-9a3f-eadfd807689f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:02.348628 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b46e1b45-4354-4e8a-9a3f-eadfd807689f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:02.349325 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b46e1b45-4354-4e8a-9a3f-eadfd807689f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:02.349779 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b46e1b45-4354-4e8a-9a3f-eadfd807689f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:02.350236 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b46e1b45-4354-4e8a-9a3f-eadfd807689f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:02.485637 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-b46e1b45-4354-4e8a-9a3f-eadfd807689f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:02.495166 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-b46e1b45-4354-4e8a-9a3f-eadfd807689f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1725 microversion: 2.1 time: 0.159899 Oct 19 00:43:02.495774 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 261/479] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:02 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:02.904610 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-55523685-5de1-4017-8033-c9016ff63975 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:02.905243 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-55523685-5de1-4017-8033-c9016ff63975 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:02.907556 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:02.913711 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-55523685-5de1-4017-8033-c9016ff63975 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:02.914208 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-55523685-5de1-4017-8033-c9016ff63975 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:02.914581 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-55523685-5de1-4017-8033-c9016ff63975 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:02.915273 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-55523685-5de1-4017-8033-c9016ff63975 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:02.915720 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-55523685-5de1-4017-8033-c9016ff63975 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:02.916171 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-55523685-5de1-4017-8033-c9016ff63975 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:02.976510 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-4d5e792f-4594-40eb-a747-6a702eca215d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:02.977081 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-4d5e792f-4594-40eb-a747-6a702eca215d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:02.982985 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4d5e792f-4594-40eb-a747-6a702eca215d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:02.983463 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4d5e792f-4594-40eb-a747-6a702eca215d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:02.983925 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4d5e792f-4594-40eb-a747-6a702eca215d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:02.984612 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4d5e792f-4594-40eb-a747-6a702eca215d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:02.985078 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4d5e792f-4594-40eb-a747-6a702eca215d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:02.985484 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4d5e792f-4594-40eb-a747-6a702eca215d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:03.046072 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-55523685-5de1-4017-8033-c9016ff63975 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:03.054429 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-55523685-5de1-4017-8033-c9016ff63975 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:03.056007 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-55523685-5de1-4017-8033-c9016ff63975 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:03.057458 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-55523685-5de1-4017-8033-c9016ff63975 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1738 microversion: 2.20 time: 0.156517 Oct 19 00:43:03.058101 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 219/480] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:02 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:03.112793 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-4d5e792f-4594-40eb-a747-6a702eca215d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:03.120663 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-4d5e792f-4594-40eb-a747-6a702eca215d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1359 microversion: 2.1 time: 0.148803 Oct 19 00:43:03.121226 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 262/481] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:02 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:43:03.362447 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-abd9b7fe-6338-4eeb-863d-0c5c3a42c060 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:03.363059 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-abd9b7fe-6338-4eeb-863d-0c5c3a42c060 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:03.369186 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-abd9b7fe-6338-4eeb-863d-0c5c3a42c060 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:03.369667 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-abd9b7fe-6338-4eeb-863d-0c5c3a42c060 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:03.370106 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-abd9b7fe-6338-4eeb-863d-0c5c3a42c060 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:03.370793 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-abd9b7fe-6338-4eeb-863d-0c5c3a42c060 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:03.371241 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-abd9b7fe-6338-4eeb-863d-0c5c3a42c060 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:03.371661 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-abd9b7fe-6338-4eeb-863d-0c5c3a42c060 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:03.501849 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-abd9b7fe-6338-4eeb-863d-0c5c3a42c060 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:03.510196 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-abd9b7fe-6338-4eeb-863d-0c5c3a42c060 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7" status: 200 len: 1556 microversion: 2.1 time: 0.151785 Oct 19 00:43:03.510765 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 220/482] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:03 2022] GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:03.520317 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-12c79eab-2270-42da-80e1-94e73b5f94f0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:03.520928 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-12c79eab-2270-42da-80e1-94e73b5f94f0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:03.527365 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-12c79eab-2270-42da-80e1-94e73b5f94f0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:03.527876 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-12c79eab-2270-42da-80e1-94e73b5f94f0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:03.528325 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-12c79eab-2270-42da-80e1-94e73b5f94f0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:03.529021 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-12c79eab-2270-42da-80e1-94e73b5f94f0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:03.529475 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-12c79eab-2270-42da-80e1-94e73b5f94f0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:03.529897 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-12c79eab-2270-42da-80e1-94e73b5f94f0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:03.531514 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-78a690a4-3791-4cfd-a7b1-0bd149a98531 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:03.532025 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-78a690a4-3791-4cfd-a7b1-0bd149a98531 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:03.537716 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-78a690a4-3791-4cfd-a7b1-0bd149a98531 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:03.538195 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-78a690a4-3791-4cfd-a7b1-0bd149a98531 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:03.538840 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-78a690a4-3791-4cfd-a7b1-0bd149a98531 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:03.539525 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-78a690a4-3791-4cfd-a7b1-0bd149a98531 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:03.540005 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-78a690a4-3791-4cfd-a7b1-0bd149a98531 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:03.540426 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-78a690a4-3791-4cfd-a7b1-0bd149a98531 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:03.618910 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-78a690a4-3791-4cfd-a7b1-0bd149a98531 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090787 Oct 19 00:43:03.619571 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 221/483] 10.222.0.33 () {58 vars in 1275 bytes} [Wed Oct 19 00:43:03 2022] GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:43:03.722485 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-12c79eab-2270-42da-80e1-94e73b5f94f0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:03.735214 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-12c79eab-2270-42da-80e1-94e73b5f94f0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1725 microversion: 2.1 time: 0.217361 Oct 19 00:43:03.736945 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 263/484] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:03 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:04.087773 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-8bf2a92d-265e-4754-bb8f-635230e60b8b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:04.089079 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-8bf2a92d-265e-4754-bb8f-635230e60b8b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:04.096935 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8bf2a92d-265e-4754-bb8f-635230e60b8b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:04.097955 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8bf2a92d-265e-4754-bb8f-635230e60b8b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:04.098696 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8bf2a92d-265e-4754-bb8f-635230e60b8b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:04.099700 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8bf2a92d-265e-4754-bb8f-635230e60b8b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:04.100740 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8bf2a92d-265e-4754-bb8f-635230e60b8b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:04.101629 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8bf2a92d-265e-4754-bb8f-635230e60b8b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:04.143779 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-4be0a714-da65-45e8-8d0a-c8006759e39b tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:04.144397 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-4be0a714-da65-45e8-8d0a-c8006759e39b tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:04.157558 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4be0a714-da65-45e8-8d0a-c8006759e39b tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:04.158330 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4be0a714-da65-45e8-8d0a-c8006759e39b tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:04.158953 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4be0a714-da65-45e8-8d0a-c8006759e39b tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:04.159820 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4be0a714-da65-45e8-8d0a-c8006759e39b tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:04.160472 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4be0a714-da65-45e8-8d0a-c8006759e39b tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:04.161050 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4be0a714-da65-45e8-8d0a-c8006759e39b tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:04.557859 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-4be0a714-da65-45e8-8d0a-c8006759e39b tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:04.604385 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-4be0a714-da65-45e8-8d0a-c8006759e39b tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1359 microversion: 2.1 time: 0.464534 Oct 19 00:43:04.605743 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 264/485] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:04 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1359 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:04.605867 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-8bf2a92d-265e-4754-bb8f-635230e60b8b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:04.667202 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-8bf2a92d-265e-4754-bb8f-635230e60b8b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:04.669322 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-8bf2a92d-265e-4754-bb8f-635230e60b8b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:04.670817 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-8bf2a92d-265e-4754-bb8f-635230e60b8b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1738 microversion: 2.20 time: 0.592123 Oct 19 00:43:04.671501 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 222/486] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:04 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1738 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:04.760744 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-5153c2c8-18d5-4cd0-804e-c5c88bea5310 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:04.761762 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-5153c2c8-18d5-4cd0-804e-c5c88bea5310 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:04.771421 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5153c2c8-18d5-4cd0-804e-c5c88bea5310 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:04.773590 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5153c2c8-18d5-4cd0-804e-c5c88bea5310 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:04.774043 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5153c2c8-18d5-4cd0-804e-c5c88bea5310 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:04.774786 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5153c2c8-18d5-4cd0-804e-c5c88bea5310 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:04.775243 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5153c2c8-18d5-4cd0-804e-c5c88bea5310 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:04.775665 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5153c2c8-18d5-4cd0-804e-c5c88bea5310 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:04.961332 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-5153c2c8-18d5-4cd0-804e-c5c88bea5310 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:04.963594 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell1:SELECT=100 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:04.972390 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-5153c2c8-18d5-4cd0-804e-c5c88bea5310 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1725 microversion: 2.1 time: 0.217417 Oct 19 00:43:04.975901 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 265/487] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:04 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:05.159839 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-5abbac09-2003-440d-9ace-f70d98f7470b req-2820219d-4ef1-4399-b2f4-aaf601dc797e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21c2af83-cdf5-43fb-b75e-287be2eb0db7", "tag": "c6820303-74cd-4f71-8696-e193e257c7cb"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:43:05.179173 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-5abbac09-2003-440d-9ace-f70d98f7470b req-2820219d-4ef1-4399-b2f4-aaf601dc797e service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:05.179801 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-5abbac09-2003-440d-9ace-f70d98f7470b req-2820219d-4ef1-4399-b2f4-aaf601dc797e service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:05.180268 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-5abbac09-2003-440d-9ace-f70d98f7470b req-2820219d-4ef1-4399-b2f4-aaf601dc797e service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:05.198840 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-5abbac09-2003-440d-9ace-f70d98f7470b req-2820219d-4ef1-4399-b2f4-aaf601dc797e service nova] Creating event network-changed:c6820303-74cd-4f71-8696-e193e257c7cb for instance 21c2af83-cdf5-43fb-b75e-287be2eb0db7 on hv-cinder-maste Oct 19 00:43:05.203894 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-5abbac09-2003-440d-9ace-f70d98f7470b req-2820219d-4ef1-4399-b2f4-aaf601dc797e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047702 Oct 19 00:43:05.205039 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 223/488] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:43:05.663735 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-117f3616-a83f-47ec-9f03-314c5d15005f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:05.665057 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-117f3616-a83f-47ec-9f03-314c5d15005f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:05.672152 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-117f3616-a83f-47ec-9f03-314c5d15005f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:05.672635 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-117f3616-a83f-47ec-9f03-314c5d15005f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:05.673065 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-117f3616-a83f-47ec-9f03-314c5d15005f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:05.673939 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-117f3616-a83f-47ec-9f03-314c5d15005f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:05.674545 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-117f3616-a83f-47ec-9f03-314c5d15005f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:05.675131 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-117f3616-a83f-47ec-9f03-314c5d15005f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:05.706203 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-f9ed3210-1523-43c7-a2d9-9ce37367360e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:05.706980 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-f9ed3210-1523-43c7-a2d9-9ce37367360e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:05.718806 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f9ed3210-1523-43c7-a2d9-9ce37367360e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:05.719676 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f9ed3210-1523-43c7-a2d9-9ce37367360e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:05.720305 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f9ed3210-1523-43c7-a2d9-9ce37367360e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:05.722305 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f9ed3210-1523-43c7-a2d9-9ce37367360e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:05.728838 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f9ed3210-1523-43c7-a2d9-9ce37367360e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:05.729691 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f9ed3210-1523-43c7-a2d9-9ce37367360e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:05.831447 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-117f3616-a83f-47ec-9f03-314c5d15005f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:05.843761 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-117f3616-a83f-47ec-9f03-314c5d15005f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1359 microversion: 2.1 time: 0.184677 Oct 19 00:43:05.864885 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 266/489] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:05 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1359 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:05.919840 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-f9ed3210-1523-43c7-a2d9-9ce37367360e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:05.931045 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-f9ed3210-1523-43c7-a2d9-9ce37367360e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:05.934476 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-f9ed3210-1523-43c7-a2d9-9ce37367360e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:05.936058 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-f9ed3210-1523-43c7-a2d9-9ce37367360e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1738 microversion: 2.20 time: 0.233935 Oct 19 00:43:05.938083 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 224/490] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:05 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1738 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:43:06.000901 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-69019e97-cc68-47bf-b263-f32c5f5a38e0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:06.001743 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-69019e97-cc68-47bf-b263-f32c5f5a38e0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:06.015215 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-69019e97-cc68-47bf-b263-f32c5f5a38e0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:06.015820 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-69019e97-cc68-47bf-b263-f32c5f5a38e0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:06.016294 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-69019e97-cc68-47bf-b263-f32c5f5a38e0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:06.018241 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-69019e97-cc68-47bf-b263-f32c5f5a38e0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:06.024131 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-69019e97-cc68-47bf-b263-f32c5f5a38e0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:06.024691 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-69019e97-cc68-47bf-b263-f32c5f5a38e0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:06.204082 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-69019e97-cc68-47bf-b263-f32c5f5a38e0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:06.214589 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-69019e97-cc68-47bf-b263-f32c5f5a38e0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1725 microversion: 2.1 time: 0.217518 Oct 19 00:43:06.215185 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 267/491] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:05 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:06.312592 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-c3902472-774d-42c2-a431-52f4881585f6 req-d0d1c34f-9442-45d3-99a3-b74b28ce4806 admin admin] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:06.317713 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-c3902472-774d-42c2-a431-52f4881585f6 req-d0d1c34f-9442-45d3-99a3-b74b28ce4806 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:06.318423 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-c3902472-774d-42c2-a431-52f4881585f6 req-d0d1c34f-9442-45d3-99a3-b74b28ce4806 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:06.319127 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-c3902472-774d-42c2-a431-52f4881585f6 req-d0d1c34f-9442-45d3-99a3-b74b28ce4806 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:06.328281 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-c3902472-774d-42c2-a431-52f4881585f6 req-d0d1c34f-9442-45d3-99a3-b74b28ce4806 admin admin] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:06.329006 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-c3902472-774d-42c2-a431-52f4881585f6 req-d0d1c34f-9442-45d3-99a3-b74b28ce4806 admin admin] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:06.329600 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-c3902472-774d-42c2-a431-52f4881585f6 req-d0d1c34f-9442-45d3-99a3-b74b28ce4806 admin admin] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:06.347022 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-c3902472-774d-42c2-a431-52f4881585f6 req-d0d1c34f-9442-45d3-99a3-b74b28ce4806 admin admin] 10.222.0.18 "DELETE /compute/v2.1/os-assisted-volume-snapshots/286b61bd-79e3-4e31-86ea-17d4e30a07f0?delete_info=%7B%22file_to_merge%22:%20%22volume-df3dcba1-7afd-4b49-a531-a0af55908ad8.286b61bd-79e3-4e31-86ea-17d4e30a07f0.vhdx%22,%20%22volume_id%22:%20%22df3dcba1-7afd-4b49-a531-a0af55908ad8%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.106387 Oct 19 00:43:06.348225 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 225/492] 10.222.0.18 () {62 vars in 1800 bytes} [Wed Oct 19 00:43:06 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/286b61bd-79e3-4e31-86ea-17d4e30a07f0?delete_info=%7B%22file_to_merge%22:%20%22volume-df3dcba1-7afd-4b49-a531-a0af55908ad8.286b61bd-79e3-4e31-86ea-17d4e30a07f0.vhdx%22,%20%22volume_id%22:%20%22df3dcba1-7afd-4b49-a531-a0af55908ad8%22%7D => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 00:43:06.875800 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-44b84e34-e114-415a-88d7-3008e94b5b91 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:06.876551 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-44b84e34-e114-415a-88d7-3008e94b5b91 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:06.884441 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-44b84e34-e114-415a-88d7-3008e94b5b91 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:06.885308 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-44b84e34-e114-415a-88d7-3008e94b5b91 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:06.885761 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-44b84e34-e114-415a-88d7-3008e94b5b91 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:06.886664 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-44b84e34-e114-415a-88d7-3008e94b5b91 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:06.887117 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-44b84e34-e114-415a-88d7-3008e94b5b91 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:06.887590 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-44b84e34-e114-415a-88d7-3008e94b5b91 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:06.963741 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-bd0778cd-5f6e-4d1d-8e70-3171a26650d9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:06.964873 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-bd0778cd-5f6e-4d1d-8e70-3171a26650d9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:06.972490 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bd0778cd-5f6e-4d1d-8e70-3171a26650d9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:06.973306 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bd0778cd-5f6e-4d1d-8e70-3171a26650d9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:06.974667 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bd0778cd-5f6e-4d1d-8e70-3171a26650d9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:06.975751 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bd0778cd-5f6e-4d1d-8e70-3171a26650d9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:06.976688 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bd0778cd-5f6e-4d1d-8e70-3171a26650d9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:06.977343 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bd0778cd-5f6e-4d1d-8e70-3171a26650d9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:07.032681 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-44b84e34-e114-415a-88d7-3008e94b5b91 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:07.042269 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-44b84e34-e114-415a-88d7-3008e94b5b91 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1359 microversion: 2.1 time: 0.170932 Oct 19 00:43:07.042751 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 268/493] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:06 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:07.162894 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-bd0778cd-5f6e-4d1d-8e70-3171a26650d9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:07.174656 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-bd0778cd-5f6e-4d1d-8e70-3171a26650d9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:07.176163 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-bd0778cd-5f6e-4d1d-8e70-3171a26650d9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:07.177411 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-bd0778cd-5f6e-4d1d-8e70-3171a26650d9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1738 microversion: 2.20 time: 0.219186 Oct 19 00:43:07.177982 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 226/494] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:06 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1738 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:07.239245 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-af684d0c-7b66-49b5-9208-629e04ece5bd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:07.240094 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-af684d0c-7b66-49b5-9208-629e04ece5bd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:07.247736 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-af684d0c-7b66-49b5-9208-629e04ece5bd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:07.254098 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-af684d0c-7b66-49b5-9208-629e04ece5bd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:07.254551 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-af684d0c-7b66-49b5-9208-629e04ece5bd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:07.255306 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-af684d0c-7b66-49b5-9208-629e04ece5bd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:07.255773 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-af684d0c-7b66-49b5-9208-629e04ece5bd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:07.256225 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-af684d0c-7b66-49b5-9208-629e04ece5bd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:07.425766 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-af684d0c-7b66-49b5-9208-629e04ece5bd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:07.436803 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-af684d0c-7b66-49b5-9208-629e04ece5bd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1725 microversion: 2.1 time: 0.201999 Oct 19 00:43:07.437381 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 269/495] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:07 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1725 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:08.068596 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-8dd5f680-75cb-4ce4-8595-9a85f5c54f4c tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:08.070118 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-8dd5f680-75cb-4ce4-8595-9a85f5c54f4c tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:08.076678 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8dd5f680-75cb-4ce4-8595-9a85f5c54f4c tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:08.077265 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8dd5f680-75cb-4ce4-8595-9a85f5c54f4c tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:08.077716 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8dd5f680-75cb-4ce4-8595-9a85f5c54f4c tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:08.078483 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8dd5f680-75cb-4ce4-8595-9a85f5c54f4c tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:08.078973 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8dd5f680-75cb-4ce4-8595-9a85f5c54f4c tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:08.079587 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8dd5f680-75cb-4ce4-8595-9a85f5c54f4c tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:08.213786 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-22f6de99-272b-49d3-b82b-0600b6bca787 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:08.215888 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-22f6de99-272b-49d3-b82b-0600b6bca787 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:08.224559 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-22f6de99-272b-49d3-b82b-0600b6bca787 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:08.225302 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-22f6de99-272b-49d3-b82b-0600b6bca787 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:08.226440 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-22f6de99-272b-49d3-b82b-0600b6bca787 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:08.227828 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-22f6de99-272b-49d3-b82b-0600b6bca787 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:08.228499 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-22f6de99-272b-49d3-b82b-0600b6bca787 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:08.229119 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-22f6de99-272b-49d3-b82b-0600b6bca787 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:08.237775 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-8dd5f680-75cb-4ce4-8595-9a85f5c54f4c tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:08.246857 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-8dd5f680-75cb-4ce4-8595-9a85f5c54f4c tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1359 microversion: 2.1 time: 0.182591 Oct 19 00:43:08.247435 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 227/496] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:08 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:08.393019 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-22f6de99-272b-49d3-b82b-0600b6bca787 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:08.402311 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-22f6de99-272b-49d3-b82b-0600b6bca787 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:08.403819 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-22f6de99-272b-49d3-b82b-0600b6bca787 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:08.405016 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-22f6de99-272b-49d3-b82b-0600b6bca787 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1738 microversion: 2.20 time: 0.196503 Oct 19 00:43:08.405568 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 270/497] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:08 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1738 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:08.460968 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-03945134-1553-4332-981e-988ae0bf18aa tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:08.461747 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-03945134-1553-4332-981e-988ae0bf18aa tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:08.468023 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-03945134-1553-4332-981e-988ae0bf18aa tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:08.468632 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-03945134-1553-4332-981e-988ae0bf18aa tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:08.469071 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-03945134-1553-4332-981e-988ae0bf18aa tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:08.469763 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-03945134-1553-4332-981e-988ae0bf18aa tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:08.470220 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-03945134-1553-4332-981e-988ae0bf18aa tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:08.470641 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-03945134-1553-4332-981e-988ae0bf18aa tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:08.610687 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-03945134-1553-4332-981e-988ae0bf18aa tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:08.620534 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-03945134-1553-4332-981e-988ae0bf18aa tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1725 microversion: 2.1 time: 0.163389 Oct 19 00:43:08.621316 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 228/498] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:08 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:09.270365 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-f4d29788-1f97-4823-90eb-75a8c1f30724 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:09.271101 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-f4d29788-1f97-4823-90eb-75a8c1f30724 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:09.282425 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f4d29788-1f97-4823-90eb-75a8c1f30724 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:09.286070 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f4d29788-1f97-4823-90eb-75a8c1f30724 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:09.286637 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f4d29788-1f97-4823-90eb-75a8c1f30724 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:09.287792 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f4d29788-1f97-4823-90eb-75a8c1f30724 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:09.288373 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f4d29788-1f97-4823-90eb-75a8c1f30724 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:09.289757 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f4d29788-1f97-4823-90eb-75a8c1f30724 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:09.436692 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-75f27d31-2f7e-4dd7-9c41-8a1dcbf0c484 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:09.438199 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-75f27d31-2f7e-4dd7-9c41-8a1dcbf0c484 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:09.448773 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-75f27d31-2f7e-4dd7-9c41-8a1dcbf0c484 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:09.449579 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-75f27d31-2f7e-4dd7-9c41-8a1dcbf0c484 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:09.450247 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-75f27d31-2f7e-4dd7-9c41-8a1dcbf0c484 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:09.451596 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-75f27d31-2f7e-4dd7-9c41-8a1dcbf0c484 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:09.452550 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-75f27d31-2f7e-4dd7-9c41-8a1dcbf0c484 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:09.453210 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-75f27d31-2f7e-4dd7-9c41-8a1dcbf0c484 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:09.453788 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-f4d29788-1f97-4823-90eb-75a8c1f30724 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:09.463910 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-f4d29788-1f97-4823-90eb-75a8c1f30724 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1359 microversion: 2.1 time: 0.197606 Oct 19 00:43:09.465084 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 271/499] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:09 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1359 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:43:09.637456 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-75f27d31-2f7e-4dd7-9c41-8a1dcbf0c484 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:09.646881 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-df46bf5c-9851-4863-a650-a3db180f6d87 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:09.648439 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-df46bf5c-9851-4863-a650-a3db180f6d87 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:09.651026 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-75f27d31-2f7e-4dd7-9c41-8a1dcbf0c484 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:09.653152 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-75f27d31-2f7e-4dd7-9c41-8a1dcbf0c484 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:09.654800 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-75f27d31-2f7e-4dd7-9c41-8a1dcbf0c484 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1738 microversion: 2.20 time: 0.223808 Oct 19 00:43:09.656024 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 229/500] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:09 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1738 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:09.660176 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-df46bf5c-9851-4863-a650-a3db180f6d87 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:09.660754 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-df46bf5c-9851-4863-a650-a3db180f6d87 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:09.661338 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-df46bf5c-9851-4863-a650-a3db180f6d87 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:09.662379 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-df46bf5c-9851-4863-a650-a3db180f6d87 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:09.663787 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-df46bf5c-9851-4863-a650-a3db180f6d87 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:09.664818 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-df46bf5c-9851-4863-a650-a3db180f6d87 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:09.852214 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-df46bf5c-9851-4863-a650-a3db180f6d87 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:09.863363 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-df46bf5c-9851-4863-a650-a3db180f6d87 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1725 microversion: 2.1 time: 0.222843 Oct 19 00:43:09.875948 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 272/501] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:09 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1725 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:43:10.487597 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-8584d568-79ab-4b58-9775-7442fe55ccae tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:10.488859 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-8584d568-79ab-4b58-9775-7442fe55ccae tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:10.496881 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8584d568-79ab-4b58-9775-7442fe55ccae tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:10.497374 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8584d568-79ab-4b58-9775-7442fe55ccae tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:10.497814 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8584d568-79ab-4b58-9775-7442fe55ccae tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:10.498880 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8584d568-79ab-4b58-9775-7442fe55ccae tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:10.498998 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8584d568-79ab-4b58-9775-7442fe55ccae tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:10.499399 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8584d568-79ab-4b58-9775-7442fe55ccae tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:10.662392 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-8584d568-79ab-4b58-9775-7442fe55ccae tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:10.674861 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-8584d568-79ab-4b58-9775-7442fe55ccae tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1359 microversion: 2.1 time: 0.191150 Oct 19 00:43:10.681992 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 230/502] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:10 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1359 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:10.683670 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-7e92d3f0-575f-482c-b1ec-181f4d9d9118 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:10.684649 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-7e92d3f0-575f-482c-b1ec-181f4d9d9118 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:10.692266 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7e92d3f0-575f-482c-b1ec-181f4d9d9118 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:10.692986 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7e92d3f0-575f-482c-b1ec-181f4d9d9118 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:10.693413 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7e92d3f0-575f-482c-b1ec-181f4d9d9118 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:10.695719 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7e92d3f0-575f-482c-b1ec-181f4d9d9118 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:10.697426 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7e92d3f0-575f-482c-b1ec-181f4d9d9118 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:10.698461 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7e92d3f0-575f-482c-b1ec-181f4d9d9118 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:10.861632 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-7e92d3f0-575f-482c-b1ec-181f4d9d9118 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:10.870836 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-7e92d3f0-575f-482c-b1ec-181f4d9d9118 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:10.872323 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-7e92d3f0-575f-482c-b1ec-181f4d9d9118 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:10.873523 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-7e92d3f0-575f-482c-b1ec-181f4d9d9118 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1738 microversion: 2.20 time: 0.194485 Oct 19 00:43:10.874099 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 273/503] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:10 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:43:10.891920 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-9bc92e7e-c8d0-47e2-acd9-30e1fccb95e1 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:10.892544 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-9bc92e7e-c8d0-47e2-acd9-30e1fccb95e1 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:10.899636 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9bc92e7e-c8d0-47e2-acd9-30e1fccb95e1 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:10.900159 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9bc92e7e-c8d0-47e2-acd9-30e1fccb95e1 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:10.900600 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9bc92e7e-c8d0-47e2-acd9-30e1fccb95e1 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:10.901319 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9bc92e7e-c8d0-47e2-acd9-30e1fccb95e1 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:10.901840 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9bc92e7e-c8d0-47e2-acd9-30e1fccb95e1 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:10.902268 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9bc92e7e-c8d0-47e2-acd9-30e1fccb95e1 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:11.066426 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-9bc92e7e-c8d0-47e2-acd9-30e1fccb95e1 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:11.075930 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-9bc92e7e-c8d0-47e2-acd9-30e1fccb95e1 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1725 microversion: 2.1 time: 0.188023 Oct 19 00:43:11.087947 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 231/504] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:10 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:11.575527 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-b28597a4-4af8-4d1d-b28f-1ff6659425bb req-96db0af3-72fb-46e9-9e8c-e6b49702ce04 admin admin] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:11.579316 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-b28597a4-4af8-4d1d-b28f-1ff6659425bb req-96db0af3-72fb-46e9-9e8c-e6b49702ce04 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:11.579800 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-b28597a4-4af8-4d1d-b28f-1ff6659425bb req-96db0af3-72fb-46e9-9e8c-e6b49702ce04 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:11.580352 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-b28597a4-4af8-4d1d-b28f-1ff6659425bb req-96db0af3-72fb-46e9-9e8c-e6b49702ce04 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:11.589381 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-b28597a4-4af8-4d1d-b28f-1ff6659425bb req-96db0af3-72fb-46e9-9e8c-e6b49702ce04 admin admin] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:11.589868 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-b28597a4-4af8-4d1d-b28f-1ff6659425bb req-96db0af3-72fb-46e9-9e8c-e6b49702ce04 admin admin] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:11.590428 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-b28597a4-4af8-4d1d-b28f-1ff6659425bb req-96db0af3-72fb-46e9-9e8c-e6b49702ce04 admin admin] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:11.605267 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-b28597a4-4af8-4d1d-b28f-1ff6659425bb req-96db0af3-72fb-46e9-9e8c-e6b49702ce04 admin admin] 10.222.0.18 "DELETE /compute/v2.1/os-assisted-volume-snapshots/359ed470-bb2b-464b-951d-014e3aa728e4?delete_info=%7B%22file_to_merge%22:%20%22volume-df3dcba1-7afd-4b49-a531-a0af55908ad8.359ed470-bb2b-464b-951d-014e3aa728e4.vhdx%22,%20%22volume_id%22:%20%22df3dcba1-7afd-4b49-a531-a0af55908ad8%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.082163 Oct 19 00:43:11.606496 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 274/505] 10.222.0.18 () {62 vars in 1800 bytes} [Wed Oct 19 00:43:11 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/359ed470-bb2b-464b-951d-014e3aa728e4?delete_info=%7B%22file_to_merge%22:%20%22volume-df3dcba1-7afd-4b49-a531-a0af55908ad8.359ed470-bb2b-464b-951d-014e3aa728e4.vhdx%22,%20%22volume_id%22:%20%22df3dcba1-7afd-4b49-a531-a0af55908ad8%22%7D => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 00:43:11.706872 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-986d7b26-ad39-4a76-ad85-9f395a874abf tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:11.708546 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-986d7b26-ad39-4a76-ad85-9f395a874abf tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:11.751040 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-986d7b26-ad39-4a76-ad85-9f395a874abf tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:11.752096 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-986d7b26-ad39-4a76-ad85-9f395a874abf tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:11.752890 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-986d7b26-ad39-4a76-ad85-9f395a874abf tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:11.753821 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-986d7b26-ad39-4a76-ad85-9f395a874abf tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:11.754476 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-986d7b26-ad39-4a76-ad85-9f395a874abf tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:11.755066 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-986d7b26-ad39-4a76-ad85-9f395a874abf tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:11.872412 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-00c3b084-5590-4d22-bf18-d2dee99080d4 req-6187645b-e304-4851-b082-fec533924df9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09190732-7307-4684-a264-9b5b31301df4", "name": "network-vif-plugged", "status": "completed", "tag": "c199c72b-1e56-47e2-b8a5-93c07ba36102"}]} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:43:11.899474 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-00c3b084-5590-4d22-bf18-d2dee99080d4 req-6187645b-e304-4851-b082-fec533924df9 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:11.899981 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-00c3b084-5590-4d22-bf18-d2dee99080d4 req-6187645b-e304-4851-b082-fec533924df9 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:11.900407 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-00c3b084-5590-4d22-bf18-d2dee99080d4 req-6187645b-e304-4851-b082-fec533924df9 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:11.921367 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.compute.server_external_events [req-00c3b084-5590-4d22-bf18-d2dee99080d4 req-6187645b-e304-4851-b082-fec533924df9 service nova] Creating event network-vif-plugged:c199c72b-1e56-47e2-b8a5-93c07ba36102 for instance 09190732-7307-4684-a264-9b5b31301df4 on hv-cinder-maste Oct 19 00:43:11.930648 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-00c3b084-5590-4d22-bf18-d2dee99080d4 req-6187645b-e304-4851-b082-fec533924df9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069211 Oct 19 00:43:11.931580 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 275/506] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:43:11.937643 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-646c6f8b-187a-4966-8ec0-16da5a6b87bf tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:11.939108 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-646c6f8b-187a-4966-8ec0-16da5a6b87bf tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:11.945525 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-646c6f8b-187a-4966-8ec0-16da5a6b87bf tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:11.946200 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-646c6f8b-187a-4966-8ec0-16da5a6b87bf tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:11.946783 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-646c6f8b-187a-4966-8ec0-16da5a6b87bf tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:11.947642 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-646c6f8b-187a-4966-8ec0-16da5a6b87bf tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:11.948292 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-646c6f8b-187a-4966-8ec0-16da5a6b87bf tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:11.948861 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-646c6f8b-187a-4966-8ec0-16da5a6b87bf tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:11.993270 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-986d7b26-ad39-4a76-ad85-9f395a874abf tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:12.004659 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-986d7b26-ad39-4a76-ad85-9f395a874abf tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1359 microversion: 2.1 time: 0.302680 Oct 19 00:43:12.019876 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 232/507] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:11 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1359 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:12.102129 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-7c334438-3b50-432e-b5fa-097ac15dda7c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:12.102741 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-7c334438-3b50-432e-b5fa-097ac15dda7c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:12.108287 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-646c6f8b-187a-4966-8ec0-16da5a6b87bf tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:12.108864 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7c334438-3b50-432e-b5fa-097ac15dda7c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:12.109362 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7c334438-3b50-432e-b5fa-097ac15dda7c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:12.109800 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7c334438-3b50-432e-b5fa-097ac15dda7c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:12.110707 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7c334438-3b50-432e-b5fa-097ac15dda7c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:12.111168 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7c334438-3b50-432e-b5fa-097ac15dda7c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:12.111750 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7c334438-3b50-432e-b5fa-097ac15dda7c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:12.123427 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-646c6f8b-187a-4966-8ec0-16da5a6b87bf tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:12.125037 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-646c6f8b-187a-4966-8ec0-16da5a6b87bf tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:12.126311 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-646c6f8b-187a-4966-8ec0-16da5a6b87bf tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1738 microversion: 2.20 time: 0.193403 Oct 19 00:43:12.133099 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 276/508] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:11 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1738 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:12.274207 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-7c334438-3b50-432e-b5fa-097ac15dda7c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:12.286885 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-7c334438-3b50-432e-b5fa-097ac15dda7c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1725 microversion: 2.1 time: 0.189441 Oct 19 00:43:12.288334 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 233/509] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:12 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:43:13.030722 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-d538d57c-1aac-45d5-b029-938f3f2289b2 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:13.031337 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-d538d57c-1aac-45d5-b029-938f3f2289b2 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:13.039385 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d538d57c-1aac-45d5-b029-938f3f2289b2 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:13.040146 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d538d57c-1aac-45d5-b029-938f3f2289b2 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:13.040740 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d538d57c-1aac-45d5-b029-938f3f2289b2 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:13.041437 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d538d57c-1aac-45d5-b029-938f3f2289b2 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:13.041885 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d538d57c-1aac-45d5-b029-938f3f2289b2 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:13.042964 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d538d57c-1aac-45d5-b029-938f3f2289b2 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:13.154011 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-b6b4e9a4-df90-4661-83ef-545c738421e9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:13.154749 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-b6b4e9a4-df90-4661-83ef-545c738421e9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:13.163673 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b6b4e9a4-df90-4661-83ef-545c738421e9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:13.164435 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b6b4e9a4-df90-4661-83ef-545c738421e9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:13.165017 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b6b4e9a4-df90-4661-83ef-545c738421e9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:13.166007 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b6b4e9a4-df90-4661-83ef-545c738421e9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:13.166659 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b6b4e9a4-df90-4661-83ef-545c738421e9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:13.167278 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b6b4e9a4-df90-4661-83ef-545c738421e9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:13.202239 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-d538d57c-1aac-45d5-b029-938f3f2289b2 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:13.210584 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-d538d57c-1aac-45d5-b029-938f3f2289b2 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1359 microversion: 2.1 time: 0.183829 Oct 19 00:43:13.211168 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 277/510] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:13 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:13.314292 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-d4e8dc03-18ed-4b31-b3b5-521743609207 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:13.315279 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-d4e8dc03-18ed-4b31-b3b5-521743609207 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:13.320861 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-b6b4e9a4-df90-4661-83ef-545c738421e9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:13.325833 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d4e8dc03-18ed-4b31-b3b5-521743609207 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:13.326334 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d4e8dc03-18ed-4b31-b3b5-521743609207 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:13.326786 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d4e8dc03-18ed-4b31-b3b5-521743609207 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:13.327497 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d4e8dc03-18ed-4b31-b3b5-521743609207 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:13.327975 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d4e8dc03-18ed-4b31-b3b5-521743609207 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:13.328607 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d4e8dc03-18ed-4b31-b3b5-521743609207 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:13.333626 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-b6b4e9a4-df90-4661-83ef-545c738421e9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:13.336468 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-b6b4e9a4-df90-4661-83ef-545c738421e9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:13.337974 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-b6b4e9a4-df90-4661-83ef-545c738421e9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1738 microversion: 2.20 time: 0.188147 Oct 19 00:43:13.339424 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 234/511] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:13 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:13.496815 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-d4e8dc03-18ed-4b31-b3b5-521743609207 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:13.507791 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-d4e8dc03-18ed-4b31-b3b5-521743609207 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1725 microversion: 2.1 time: 0.197238 Oct 19 00:43:13.508664 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 278/512] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:13 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1725 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:14.233609 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-dda1b519-91f5-4791-931a-f7818a82de5c tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:14.234208 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-dda1b519-91f5-4791-931a-f7818a82de5c tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:14.241452 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dda1b519-91f5-4791-931a-f7818a82de5c tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:14.242018 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dda1b519-91f5-4791-931a-f7818a82de5c tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:14.242417 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dda1b519-91f5-4791-931a-f7818a82de5c tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:14.243103 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dda1b519-91f5-4791-931a-f7818a82de5c tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:14.243566 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dda1b519-91f5-4791-931a-f7818a82de5c tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:14.243991 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dda1b519-91f5-4791-931a-f7818a82de5c tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:14.260165 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell1:SELECT=100 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:14.368642 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-284095c4-7854-4443-b13f-2613edd40ac3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:14.369311 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-284095c4-7854-4443-b13f-2613edd40ac3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:14.380774 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-284095c4-7854-4443-b13f-2613edd40ac3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:14.381252 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-284095c4-7854-4443-b13f-2613edd40ac3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:14.383245 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-284095c4-7854-4443-b13f-2613edd40ac3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:14.385698 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-284095c4-7854-4443-b13f-2613edd40ac3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:14.386362 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-284095c4-7854-4443-b13f-2613edd40ac3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:14.386979 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-284095c4-7854-4443-b13f-2613edd40ac3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:14.411890 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-dda1b519-91f5-4791-931a-f7818a82de5c tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:14.424483 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-dda1b519-91f5-4791-931a-f7818a82de5c tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1359 microversion: 2.1 time: 0.193983 Oct 19 00:43:14.426040 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 235/513] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:14 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:43:14.531841 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-a4c11cb5-2f81-4cee-a5df-b30ea3404d7e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:14.532497 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-a4c11cb5-2f81-4cee-a5df-b30ea3404d7e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:14.539417 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a4c11cb5-2f81-4cee-a5df-b30ea3404d7e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:14.539842 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a4c11cb5-2f81-4cee-a5df-b30ea3404d7e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:14.540302 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a4c11cb5-2f81-4cee-a5df-b30ea3404d7e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:14.541005 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a4c11cb5-2f81-4cee-a5df-b30ea3404d7e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:14.541461 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a4c11cb5-2f81-4cee-a5df-b30ea3404d7e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:14.541889 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a4c11cb5-2f81-4cee-a5df-b30ea3404d7e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:14.558919 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-284095c4-7854-4443-b13f-2613edd40ac3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:14.574719 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-284095c4-7854-4443-b13f-2613edd40ac3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:14.576334 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-284095c4-7854-4443-b13f-2613edd40ac3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:14.577520 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-284095c4-7854-4443-b13f-2613edd40ac3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1738 microversion: 2.20 time: 0.212866 Oct 19 00:43:14.578085 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 279/514] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:14 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1738 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:43:14.696959 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-a4c11cb5-2f81-4cee-a5df-b30ea3404d7e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:14.705752 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-a4c11cb5-2f81-4cee-a5df-b30ea3404d7e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1725 microversion: 2.1 time: 0.177744 Oct 19 00:43:14.706327 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 236/515] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:14 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:43:15.452331 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-fdb35d21-4631-46cd-9bcd-3833cd3e856a tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:15.452904 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-fdb35d21-4631-46cd-9bcd-3833cd3e856a tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:15.459215 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-fdb35d21-4631-46cd-9bcd-3833cd3e856a tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:15.460474 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-fdb35d21-4631-46cd-9bcd-3833cd3e856a tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:15.460920 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-fdb35d21-4631-46cd-9bcd-3833cd3e856a tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:15.461623 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-fdb35d21-4631-46cd-9bcd-3833cd3e856a tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:15.462075 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-fdb35d21-4631-46cd-9bcd-3833cd3e856a tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:15.462501 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-fdb35d21-4631-46cd-9bcd-3833cd3e856a tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:15.600675 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-fdb35d21-4631-46cd-9bcd-3833cd3e856a tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:15.606663 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-131d0cfd-8956-4ef8-9ae9-b3f60c6a2d1b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:15.608328 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-131d0cfd-8956-4ef8-9ae9-b3f60c6a2d1b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:15.608749 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-fdb35d21-4631-46cd-9bcd-3833cd3e856a tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1359 microversion: 2.1 time: 0.160271 Oct 19 00:43:15.624363 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 280/516] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:15 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:15.629984 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-131d0cfd-8956-4ef8-9ae9-b3f60c6a2d1b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:15.630616 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-131d0cfd-8956-4ef8-9ae9-b3f60c6a2d1b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:15.632961 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-131d0cfd-8956-4ef8-9ae9-b3f60c6a2d1b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:15.640075 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-131d0cfd-8956-4ef8-9ae9-b3f60c6a2d1b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:15.640732 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-131d0cfd-8956-4ef8-9ae9-b3f60c6a2d1b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:15.641240 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-131d0cfd-8956-4ef8-9ae9-b3f60c6a2d1b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:15.733288 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-0d63abc1-29b1-453f-a9e8-35f2cfc578ab tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:15.734057 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-0d63abc1-29b1-453f-a9e8-35f2cfc578ab tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:15.740432 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0d63abc1-29b1-453f-a9e8-35f2cfc578ab tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:15.741550 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0d63abc1-29b1-453f-a9e8-35f2cfc578ab tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:15.742050 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0d63abc1-29b1-453f-a9e8-35f2cfc578ab tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:15.742842 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0d63abc1-29b1-453f-a9e8-35f2cfc578ab tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:15.743369 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0d63abc1-29b1-453f-a9e8-35f2cfc578ab tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:15.743868 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0d63abc1-29b1-453f-a9e8-35f2cfc578ab tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:15.778698 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-131d0cfd-8956-4ef8-9ae9-b3f60c6a2d1b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:15.786919 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-131d0cfd-8956-4ef8-9ae9-b3f60c6a2d1b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:15.788493 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-131d0cfd-8956-4ef8-9ae9-b3f60c6a2d1b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:15.789671 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-131d0cfd-8956-4ef8-9ae9-b3f60c6a2d1b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1738 microversion: 2.20 time: 0.190221 Oct 19 00:43:15.790329 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 237/517] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:15 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:15.874904 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-0d63abc1-29b1-453f-a9e8-35f2cfc578ab tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:15.884211 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-0d63abc1-29b1-453f-a9e8-35f2cfc578ab tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1725 microversion: 2.1 time: 0.154758 Oct 19 00:43:15.884849 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 281/518] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:15 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:43:16.568394 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-74a238d4-97b9-4757-b5ba-d7ebebbb263d tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:16.568896 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-74a238d4-97b9-4757-b5ba-d7ebebbb263d tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 04a968fc-e77d-4848-b28e-98db63fb2eea] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:16.570723 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell0:SELECT=2 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:16.576334 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-74a238d4-97b9-4757-b5ba-d7ebebbb263d tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:16.576822 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-74a238d4-97b9-4757-b5ba-d7ebebbb263d tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:16.577262 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-74a238d4-97b9-4757-b5ba-d7ebebbb263d tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:16.577960 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-74a238d4-97b9-4757-b5ba-d7ebebbb263d tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:16.578414 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-74a238d4-97b9-4757-b5ba-d7ebebbb263d tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:16.578868 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-74a238d4-97b9-4757-b5ba-d7ebebbb263d tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:16.633224 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-5d786887-ae6c-4c68-8f9c-5ce026ae92d9 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:16.633832 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-5d786887-ae6c-4c68-8f9c-5ce026ae92d9 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:16.640067 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5d786887-ae6c-4c68-8f9c-5ce026ae92d9 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:16.640547 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5d786887-ae6c-4c68-8f9c-5ce026ae92d9 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:16.640977 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5d786887-ae6c-4c68-8f9c-5ce026ae92d9 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:16.641658 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5d786887-ae6c-4c68-8f9c-5ce026ae92d9 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:16.642102 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5d786887-ae6c-4c68-8f9c-5ce026ae92d9 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:16.642522 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5d786887-ae6c-4c68-8f9c-5ce026ae92d9 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:16.707039 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.objects.instance [None req-74a238d4-97b9-4757-b5ba-d7ebebbb263d tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lazy-loading 'services' on Instance uuid 04a968fc-e77d-4848-b28e-98db63fb2eea {{(pid=125531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:43:16.826722 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-74a238d4-97b9-4757-b5ba-d7ebebbb263d tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "DELETE /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea/os-volume_attachments/df3dcba1-7afd-4b49-a531-a0af55908ad8" status: 202 len: 0 microversion: 2.1 time: 0.262023 Oct 19 00:43:16.827389 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 238/519] 10.222.0.33 () {58 vars in 1416 bytes} [Wed Oct 19 00:43:16 2022] DELETE /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea/os-volume_attachments/df3dcba1-7afd-4b49-a531-a0af55908ad8 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:43:16.832748 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-26775896-8345-408e-bf7d-7afcb24174d1 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:16.833334 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-26775896-8345-408e-bf7d-7afcb24174d1 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:16.840916 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-26775896-8345-408e-bf7d-7afcb24174d1 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:16.841412 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-26775896-8345-408e-bf7d-7afcb24174d1 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:16.841848 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-26775896-8345-408e-bf7d-7afcb24174d1 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:16.842557 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-26775896-8345-408e-bf7d-7afcb24174d1 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:16.843022 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-26775896-8345-408e-bf7d-7afcb24174d1 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:16.843423 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-26775896-8345-408e-bf7d-7afcb24174d1 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:16.985448 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-26775896-8345-408e-bf7d-7afcb24174d1 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:16.994457 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-26775896-8345-408e-bf7d-7afcb24174d1 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:16.995945 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-26775896-8345-408e-bf7d-7afcb24174d1 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:16.997161 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-26775896-8345-408e-bf7d-7afcb24174d1 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1738 microversion: 2.20 time: 0.168653 Oct 19 00:43:16.997737 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 239/520] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:16 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:16.999015 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-5d786887-ae6c-4c68-8f9c-5ce026ae92d9 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:17.002648 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-b8e1619b-a33d-4274-b584-67db84a80ff9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:17.002956 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-b8e1619b-a33d-4274-b584-67db84a80ff9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:17.007895 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-5d786887-ae6c-4c68-8f9c-5ce026ae92d9 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1548 microversion: 2.1 time: 0.379386 Oct 19 00:43:17.008779 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 282/521] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:16 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1548 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:43:17.009756 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b8e1619b-a33d-4274-b584-67db84a80ff9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:17.010244 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b8e1619b-a33d-4274-b584-67db84a80ff9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:17.010682 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b8e1619b-a33d-4274-b584-67db84a80ff9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:17.011380 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b8e1619b-a33d-4274-b584-67db84a80ff9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:17.011835 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b8e1619b-a33d-4274-b584-67db84a80ff9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:17.012296 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b8e1619b-a33d-4274-b584-67db84a80ff9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:17.030419 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-7477acda-e9ac-4eec-bea7-7bed9caa92ff tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:17.031169 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-7477acda-e9ac-4eec-bea7-7bed9caa92ff tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:17.037145 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7477acda-e9ac-4eec-bea7-7bed9caa92ff tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:17.037643 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7477acda-e9ac-4eec-bea7-7bed9caa92ff tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:17.038606 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7477acda-e9ac-4eec-bea7-7bed9caa92ff tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:17.039409 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7477acda-e9ac-4eec-bea7-7bed9caa92ff tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:17.039887 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7477acda-e9ac-4eec-bea7-7bed9caa92ff tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:17.040320 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7477acda-e9ac-4eec-bea7-7bed9caa92ff tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:17.151844 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-b8e1619b-a33d-4274-b584-67db84a80ff9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:17.160096 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-b8e1619b-a33d-4274-b584-67db84a80ff9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1725 microversion: 2.1 time: 0.161380 Oct 19 00:43:17.160671 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 240/522] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:16 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:17.181339 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-7477acda-e9ac-4eec-bea7-7bed9caa92ff tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:17.183668 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell1:SELECT=100 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:17.191126 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-7477acda-e9ac-4eec-bea7-7bed9caa92ff tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1548 microversion: 2.1 time: 0.164569 Oct 19 00:43:17.191701 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 283/523] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:17 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1548 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:43:17.213760 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-49458ca8-d3c3-4ae5-b9ef-32b01671706d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:17.218845 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-49458ca8-d3c3-4ae5-b9ef-32b01671706d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:17.219702 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-49458ca8-d3c3-4ae5-b9ef-32b01671706d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Searching by: {'deleted': False, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b'} {{(pid=125531) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 00:43:17.227512 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-49458ca8-d3c3-4ae5-b9ef-32b01671706d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:17.228014 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-49458ca8-d3c3-4ae5-b9ef-32b01671706d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:17.228442 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-49458ca8-d3c3-4ae5-b9ef-32b01671706d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:17.229159 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-49458ca8-d3c3-4ae5-b9ef-32b01671706d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:17.229604 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-49458ca8-d3c3-4ae5-b9ef-32b01671706d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:17.230020 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-49458ca8-d3c3-4ae5-b9ef-32b01671706d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:17.321117 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.multi_cell_list [None req-49458ca8-d3c3-4ae5-b9ef-32b01671706d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125531) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 00:43:17.419600 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-49458ca8-d3c3-4ae5-b9ef-32b01671706d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.210467 Oct 19 00:43:17.420215 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 241/524] 10.222.0.33 () {58 vars in 1125 bytes} [Wed Oct 19 00:43:17 2022] GET /compute/v2.1/servers => generated 343 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:43:17.431657 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-9617fcc5-fefa-45b1-913a-5882e99a3ad6 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:17.432303 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-9617fcc5-fefa-45b1-913a-5882e99a3ad6 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:17.438206 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9617fcc5-fefa-45b1-913a-5882e99a3ad6 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:17.438682 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9617fcc5-fefa-45b1-913a-5882e99a3ad6 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:17.439112 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9617fcc5-fefa-45b1-913a-5882e99a3ad6 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:17.439791 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9617fcc5-fefa-45b1-913a-5882e99a3ad6 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:17.440346 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9617fcc5-fefa-45b1-913a-5882e99a3ad6 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:17.440770 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9617fcc5-fefa-45b1-913a-5882e99a3ad6 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:17.565503 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-9617fcc5-fefa-45b1-913a-5882e99a3ad6 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:17.574887 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-9617fcc5-fefa-45b1-913a-5882e99a3ad6 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1548 microversion: 2.1 time: 0.147110 Oct 19 00:43:17.575456 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 284/525] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:17 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1548 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:18.023428 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-be85f77e-6862-4632-96f2-5c07750fd1d4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:18.024074 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-be85f77e-6862-4632-96f2-5c07750fd1d4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:18.030457 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-be85f77e-6862-4632-96f2-5c07750fd1d4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:18.030936 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-be85f77e-6862-4632-96f2-5c07750fd1d4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:18.031371 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-be85f77e-6862-4632-96f2-5c07750fd1d4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:18.032085 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-be85f77e-6862-4632-96f2-5c07750fd1d4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:18.032535 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-be85f77e-6862-4632-96f2-5c07750fd1d4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:18.032958 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-be85f77e-6862-4632-96f2-5c07750fd1d4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:18.169422 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-be85f77e-6862-4632-96f2-5c07750fd1d4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:18.179784 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-be85f77e-6862-4632-96f2-5c07750fd1d4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:18.181097 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-be85f77e-6862-4632-96f2-5c07750fd1d4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:18.182266 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-be85f77e-6862-4632-96f2-5c07750fd1d4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1720 microversion: 2.20 time: 0.163704 Oct 19 00:43:18.188206 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 242/526] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:18 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:18.188367 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-55c4ef0e-ee06-4123-a61f-8f3c3afed0a3 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:18.188367 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-55c4ef0e-ee06-4123-a61f-8f3c3afed0a3 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:18.196691 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-55c4ef0e-ee06-4123-a61f-8f3c3afed0a3 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:18.197282 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-55c4ef0e-ee06-4123-a61f-8f3c3afed0a3 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:18.197723 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-55c4ef0e-ee06-4123-a61f-8f3c3afed0a3 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:18.198424 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-55c4ef0e-ee06-4123-a61f-8f3c3afed0a3 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:18.198880 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-55c4ef0e-ee06-4123-a61f-8f3c3afed0a3 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:18.199306 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-55c4ef0e-ee06-4123-a61f-8f3c3afed0a3 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:18.328819 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-55c4ef0e-ee06-4123-a61f-8f3c3afed0a3 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:18.338038 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-55c4ef0e-ee06-4123-a61f-8f3c3afed0a3 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1725 microversion: 2.1 time: 0.157144 Oct 19 00:43:18.338604 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 285/527] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:18 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:43:19.026763 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-e1da6a5f-ece4-4e30-8464-23d34b167499 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:19.027296 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-e1da6a5f-ece4-4e30-8464-23d34b167499 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 04a968fc-e77d-4848-b28e-98db63fb2eea] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:19.033578 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e1da6a5f-ece4-4e30-8464-23d34b167499 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:19.034060 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e1da6a5f-ece4-4e30-8464-23d34b167499 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:19.034494 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e1da6a5f-ece4-4e30-8464-23d34b167499 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:19.035193 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e1da6a5f-ece4-4e30-8464-23d34b167499 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:19.035647 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e1da6a5f-ece4-4e30-8464-23d34b167499 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:19.036104 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e1da6a5f-ece4-4e30-8464-23d34b167499 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:19.061487 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-e1da6a5f-ece4-4e30-8464-23d34b167499 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 04a968fc-e77d-4848-b28e-98db63fb2eea] Going to try to terminate instance {{(pid=125531) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:43:19.116814 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-d7182a7b-682f-4889-aa05-b88080b86a6b tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "033fe2a7-9161-4635-9b91-34d87246c1dc"}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:43:19.119251 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-d7182a7b-682f-4889-aa05-b88080b86a6b tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:19.125377 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d7182a7b-682f-4889-aa05-b88080b86a6b tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:19.125837 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d7182a7b-682f-4889-aa05-b88080b86a6b tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:19.126271 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d7182a7b-682f-4889-aa05-b88080b86a6b tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:19.126969 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d7182a7b-682f-4889-aa05-b88080b86a6b tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:19.127423 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d7182a7b-682f-4889-aa05-b88080b86a6b tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:19.127844 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d7182a7b-682f-4889-aa05-b88080b86a6b tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:19.138588 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-e1da6a5f-ece4-4e30-8464-23d34b167499 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "DELETE /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea" status: 204 len: 0 microversion: 2.1 time: 0.116036 Oct 19 00:43:19.139243 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 243/528] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Oct 19 00:43:19 2022] DELETE /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:43:19.148595 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-2a6f78bb-dc61-4e4c-a6ea-9df2dc2e02fa tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:19.149286 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-2a6f78bb-dc61-4e4c-a6ea-9df2dc2e02fa tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 04a968fc-e77d-4848-b28e-98db63fb2eea] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:19.155158 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2a6f78bb-dc61-4e4c-a6ea-9df2dc2e02fa tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:19.155625 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2a6f78bb-dc61-4e4c-a6ea-9df2dc2e02fa tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:19.156079 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2a6f78bb-dc61-4e4c-a6ea-9df2dc2e02fa tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:19.156762 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2a6f78bb-dc61-4e4c-a6ea-9df2dc2e02fa tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:19.157205 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2a6f78bb-dc61-4e4c-a6ea-9df2dc2e02fa tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:19.157618 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2a6f78bb-dc61-4e4c-a6ea-9df2dc2e02fa tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:19.287313 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-2a6f78bb-dc61-4e4c-a6ea-9df2dc2e02fa tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:19.294946 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-2a6f78bb-dc61-4e4c-a6ea-9df2dc2e02fa tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea" status: 200 len: 1514 microversion: 2.1 time: 0.151421 Oct 19 00:43:19.295509 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 244/529] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:19 2022] GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:43:19.299975 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-5d4522f7-16bf-4e2c-b7a3-b021b15580c8 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:19.300605 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-5d4522f7-16bf-4e2c-b7a3-b021b15580c8 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:19.306591 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5d4522f7-16bf-4e2c-b7a3-b021b15580c8 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:19.307071 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5d4522f7-16bf-4e2c-b7a3-b021b15580c8 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:19.307504 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5d4522f7-16bf-4e2c-b7a3-b021b15580c8 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:19.308214 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5d4522f7-16bf-4e2c-b7a3-b021b15580c8 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:19.308667 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5d4522f7-16bf-4e2c-b7a3-b021b15580c8 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:19.309091 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5d4522f7-16bf-4e2c-b7a3-b021b15580c8 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:19.436077 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-5d4522f7-16bf-4e2c-b7a3-b021b15580c8 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:19.444925 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-5d4522f7-16bf-4e2c-b7a3-b021b15580c8 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:19.446368 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-5d4522f7-16bf-4e2c-b7a3-b021b15580c8 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:19.447519 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-5d4522f7-16bf-4e2c-b7a3-b021b15580c8 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1720 microversion: 2.20 time: 0.151075 Oct 19 00:43:19.448112 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 245/530] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:19 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:19.452412 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-67c9ffc4-32b0-48a5-8096-dd8bc5455557 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:19.453011 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-67c9ffc4-32b0-48a5-8096-dd8bc5455557 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:19.458466 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-67c9ffc4-32b0-48a5-8096-dd8bc5455557 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:19.459008 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-67c9ffc4-32b0-48a5-8096-dd8bc5455557 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:19.459510 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-67c9ffc4-32b0-48a5-8096-dd8bc5455557 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:19.460400 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-67c9ffc4-32b0-48a5-8096-dd8bc5455557 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:19.460857 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-67c9ffc4-32b0-48a5-8096-dd8bc5455557 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:19.461278 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-67c9ffc4-32b0-48a5-8096-dd8bc5455557 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:19.589555 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-67c9ffc4-32b0-48a5-8096-dd8bc5455557 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:19.597757 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-67c9ffc4-32b0-48a5-8096-dd8bc5455557 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1725 microversion: 2.1 time: 0.148714 Oct 19 00:43:19.598328 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 246/531] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:19 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:19.738355 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-07854fae-3779-4883-b4f6-d12eed3b8fd0 req-bc524856-de96-4ced-8274-f11588f52147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c74fb45-ef8a-4a88-8126-21c8266fddb2", "name": "network-vif-unplugged", "status": "completed", "tag": "7926b647-0ec9-46fb-9fed-f33f2ff9fbcf"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:43:19.748697 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-07854fae-3779-4883-b4f6-d12eed3b8fd0 req-bc524856-de96-4ced-8274-f11588f52147 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:19.749866 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-07854fae-3779-4883-b4f6-d12eed3b8fd0 req-bc524856-de96-4ced-8274-f11588f52147 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:19.750295 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-07854fae-3779-4883-b4f6-d12eed3b8fd0 req-bc524856-de96-4ced-8274-f11588f52147 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:19.761692 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-07854fae-3779-4883-b4f6-d12eed3b8fd0 req-bc524856-de96-4ced-8274-f11588f52147 service nova] Creating event network-vif-unplugged:7926b647-0ec9-46fb-9fed-f33f2ff9fbcf for instance 1c74fb45-ef8a-4a88-8126-21c8266fddb2 on hv-cinder-maste Oct 19 00:43:19.766496 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-07854fae-3779-4883-b4f6-d12eed3b8fd0 req-bc524856-de96-4ced-8274-f11588f52147 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032060 Oct 19 00:43:19.767082 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 247/532] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:43:20.319951 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-f863268a-cb9f-49f9-8380-ab2c62afb3d6 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:20.320564 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-f863268a-cb9f-49f9-8380-ab2c62afb3d6 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 04a968fc-e77d-4848-b28e-98db63fb2eea] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:20.327365 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f863268a-cb9f-49f9-8380-ab2c62afb3d6 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:20.327840 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f863268a-cb9f-49f9-8380-ab2c62afb3d6 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:20.328296 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f863268a-cb9f-49f9-8380-ab2c62afb3d6 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:20.328978 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f863268a-cb9f-49f9-8380-ab2c62afb3d6 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:20.329424 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f863268a-cb9f-49f9-8380-ab2c62afb3d6 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:20.329867 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f863268a-cb9f-49f9-8380-ab2c62afb3d6 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:20.465016 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-f863268a-cb9f-49f9-8380-ab2c62afb3d6 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:20.473049 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-f863268a-cb9f-49f9-8380-ab2c62afb3d6 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea" status: 200 len: 1514 microversion: 2.1 time: 0.157834 Oct 19 00:43:20.473607 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 248/533] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:20 2022] GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:43:20.478038 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-bd67eeda-32cd-4a97-9dc4-d5c5549bbfbc tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:20.478711 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-bd67eeda-32cd-4a97-9dc4-d5c5549bbfbc tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:20.484283 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bd67eeda-32cd-4a97-9dc4-d5c5549bbfbc tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:20.484802 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bd67eeda-32cd-4a97-9dc4-d5c5549bbfbc tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:20.485230 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bd67eeda-32cd-4a97-9dc4-d5c5549bbfbc tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:20.485910 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bd67eeda-32cd-4a97-9dc4-d5c5549bbfbc tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:20.486357 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bd67eeda-32cd-4a97-9dc4-d5c5549bbfbc tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:20.486773 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bd67eeda-32cd-4a97-9dc4-d5c5549bbfbc tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:20.620285 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-bd67eeda-32cd-4a97-9dc4-d5c5549bbfbc tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:20.628736 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-bd67eeda-32cd-4a97-9dc4-d5c5549bbfbc tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:20.630189 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-bd67eeda-32cd-4a97-9dc4-d5c5549bbfbc tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:20.632673 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-bd67eeda-32cd-4a97-9dc4-d5c5549bbfbc tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1720 microversion: 2.20 time: 0.156833 Oct 19 00:43:20.633259 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 249/534] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:20 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:20.637565 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-0047d978-ed47-4bdc-82bd-99b9990ae64f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:20.638168 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-0047d978-ed47-4bdc-82bd-99b9990ae64f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:20.643922 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0047d978-ed47-4bdc-82bd-99b9990ae64f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:20.644401 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0047d978-ed47-4bdc-82bd-99b9990ae64f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:20.644831 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0047d978-ed47-4bdc-82bd-99b9990ae64f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:20.645512 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0047d978-ed47-4bdc-82bd-99b9990ae64f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:20.645960 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0047d978-ed47-4bdc-82bd-99b9990ae64f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:20.646378 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0047d978-ed47-4bdc-82bd-99b9990ae64f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:20.651400 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:20.780557 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-0047d978-ed47-4bdc-82bd-99b9990ae64f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:20.788843 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-0047d978-ed47-4bdc-82bd-99b9990ae64f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1725 microversion: 2.1 time: 0.154650 Oct 19 00:43:20.789404 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 250/535] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:20 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:21.497679 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-ab168875-d520-4b70-a46f-3fa00c894097 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:21.498389 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-ab168875-d520-4b70-a46f-3fa00c894097 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 04a968fc-e77d-4848-b28e-98db63fb2eea] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:21.504726 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ab168875-d520-4b70-a46f-3fa00c894097 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:21.505197 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ab168875-d520-4b70-a46f-3fa00c894097 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:21.505622 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ab168875-d520-4b70-a46f-3fa00c894097 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:21.506299 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ab168875-d520-4b70-a46f-3fa00c894097 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:21.506740 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ab168875-d520-4b70-a46f-3fa00c894097 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:21.507495 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ab168875-d520-4b70-a46f-3fa00c894097 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:21.585755 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell0:SELECT=2 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:21.634262 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-ab168875-d520-4b70-a46f-3fa00c894097 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:21.641796 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-ab168875-d520-4b70-a46f-3fa00c894097 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea" status: 200 len: 1514 microversion: 2.1 time: 0.147924 Oct 19 00:43:21.642354 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 251/536] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:21 2022] GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:43:21.657893 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-7045c086-af26-4dd5-acbc-0e7d17940f00 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:21.658494 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-7045c086-af26-4dd5-acbc-0e7d17940f00 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:21.664900 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7045c086-af26-4dd5-acbc-0e7d17940f00 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:21.665370 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7045c086-af26-4dd5-acbc-0e7d17940f00 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:21.665799 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7045c086-af26-4dd5-acbc-0e7d17940f00 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:21.666475 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7045c086-af26-4dd5-acbc-0e7d17940f00 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:21.666953 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7045c086-af26-4dd5-acbc-0e7d17940f00 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:21.667375 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7045c086-af26-4dd5-acbc-0e7d17940f00 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:21.797231 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-7045c086-af26-4dd5-acbc-0e7d17940f00 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:21.805647 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-7045c086-af26-4dd5-acbc-0e7d17940f00 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:21.807093 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-7045c086-af26-4dd5-acbc-0e7d17940f00 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:21.808518 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-7045c086-af26-4dd5-acbc-0e7d17940f00 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1720 microversion: 2.20 time: 0.154315 Oct 19 00:43:21.809066 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 252/537] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:21 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:43:21.813369 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-25987f7c-ae9a-48f6-ab83-f610696beb6f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:21.813964 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-25987f7c-ae9a-48f6-ab83-f610696beb6f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:21.819926 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-25987f7c-ae9a-48f6-ab83-f610696beb6f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:21.820397 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-25987f7c-ae9a-48f6-ab83-f610696beb6f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:21.820829 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-25987f7c-ae9a-48f6-ab83-f610696beb6f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:21.821506 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-25987f7c-ae9a-48f6-ab83-f610696beb6f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:21.821949 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-25987f7c-ae9a-48f6-ab83-f610696beb6f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:21.822362 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-25987f7c-ae9a-48f6-ab83-f610696beb6f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:21.949433 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-25987f7c-ae9a-48f6-ab83-f610696beb6f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:21.957607 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-25987f7c-ae9a-48f6-ab83-f610696beb6f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1725 microversion: 2.1 time: 0.147620 Oct 19 00:43:21.958170 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 253/538] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:21 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:22.666021 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-0342d596-f99f-41bd-95ae-e88e5d37f0d9 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:22.666608 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-0342d596-f99f-41bd-95ae-e88e5d37f0d9 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 04a968fc-e77d-4848-b28e-98db63fb2eea] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:22.673205 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0342d596-f99f-41bd-95ae-e88e5d37f0d9 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:22.673681 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0342d596-f99f-41bd-95ae-e88e5d37f0d9 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:22.674108 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0342d596-f99f-41bd-95ae-e88e5d37f0d9 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:22.674786 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0342d596-f99f-41bd-95ae-e88e5d37f0d9 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:22.675230 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0342d596-f99f-41bd-95ae-e88e5d37f0d9 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:22.675641 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0342d596-f99f-41bd-95ae-e88e5d37f0d9 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:22.806883 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-0342d596-f99f-41bd-95ae-e88e5d37f0d9 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:22.814912 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-0342d596-f99f-41bd-95ae-e88e5d37f0d9 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea" status: 200 len: 1514 microversion: 2.1 time: 0.153246 Oct 19 00:43:22.815479 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 254/539] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:22 2022] GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:43:22.833170 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-651d6b3a-0ea1-4647-953d-4cc3dc6d84c2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:22.833762 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-651d6b3a-0ea1-4647-953d-4cc3dc6d84c2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:22.839381 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-651d6b3a-0ea1-4647-953d-4cc3dc6d84c2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:22.839873 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-651d6b3a-0ea1-4647-953d-4cc3dc6d84c2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:22.840308 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-651d6b3a-0ea1-4647-953d-4cc3dc6d84c2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:22.840982 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-651d6b3a-0ea1-4647-953d-4cc3dc6d84c2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:22.841428 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-651d6b3a-0ea1-4647-953d-4cc3dc6d84c2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:22.841848 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-651d6b3a-0ea1-4647-953d-4cc3dc6d84c2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:22.968106 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-651d6b3a-0ea1-4647-953d-4cc3dc6d84c2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:22.976979 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-651d6b3a-0ea1-4647-953d-4cc3dc6d84c2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:22.978424 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-651d6b3a-0ea1-4647-953d-4cc3dc6d84c2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:22.979582 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-651d6b3a-0ea1-4647-953d-4cc3dc6d84c2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1720 microversion: 2.20 time: 0.149985 Oct 19 00:43:22.980168 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 255/540] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:22 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:43:22.984496 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-44db76cb-e1b5-4cdc-a14a-639d82d3b018 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:22.985098 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-44db76cb-e1b5-4cdc-a14a-639d82d3b018 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:22.991624 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-44db76cb-e1b5-4cdc-a14a-639d82d3b018 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:22.992271 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-44db76cb-e1b5-4cdc-a14a-639d82d3b018 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:22.992707 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-44db76cb-e1b5-4cdc-a14a-639d82d3b018 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:22.993393 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-44db76cb-e1b5-4cdc-a14a-639d82d3b018 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:22.993846 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-44db76cb-e1b5-4cdc-a14a-639d82d3b018 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:22.994266 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-44db76cb-e1b5-4cdc-a14a-639d82d3b018 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:23.122290 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-44db76cb-e1b5-4cdc-a14a-639d82d3b018 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:23.130395 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-44db76cb-e1b5-4cdc-a14a-639d82d3b018 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1725 microversion: 2.1 time: 0.149311 Oct 19 00:43:23.130960 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 256/541] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:22 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:23.837640 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-e0e2f0df-3863-4e1c-b5f6-0b43ad2d9c29 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:23.838288 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-e0e2f0df-3863-4e1c-b5f6-0b43ad2d9c29 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 04a968fc-e77d-4848-b28e-98db63fb2eea] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:23.844746 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e0e2f0df-3863-4e1c-b5f6-0b43ad2d9c29 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:23.845244 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e0e2f0df-3863-4e1c-b5f6-0b43ad2d9c29 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:23.845659 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e0e2f0df-3863-4e1c-b5f6-0b43ad2d9c29 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:23.846343 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e0e2f0df-3863-4e1c-b5f6-0b43ad2d9c29 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:23.846796 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e0e2f0df-3863-4e1c-b5f6-0b43ad2d9c29 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:23.847219 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e0e2f0df-3863-4e1c-b5f6-0b43ad2d9c29 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:23.974356 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-e0e2f0df-3863-4e1c-b5f6-0b43ad2d9c29 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:23.982251 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-e0e2f0df-3863-4e1c-b5f6-0b43ad2d9c29 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea" status: 200 len: 1514 microversion: 2.1 time: 0.148506 Oct 19 00:43:23.982821 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 257/542] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:23 2022] GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:43:24.005113 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-1c0512a1-7497-42d6-af7b-b50529f7e795 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:24.005711 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-1c0512a1-7497-42d6-af7b-b50529f7e795 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:24.012364 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1c0512a1-7497-42d6-af7b-b50529f7e795 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:24.012837 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1c0512a1-7497-42d6-af7b-b50529f7e795 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:24.013260 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1c0512a1-7497-42d6-af7b-b50529f7e795 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:24.013934 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1c0512a1-7497-42d6-af7b-b50529f7e795 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:24.014379 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1c0512a1-7497-42d6-af7b-b50529f7e795 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:24.014796 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1c0512a1-7497-42d6-af7b-b50529f7e795 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:24.142319 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-1c0512a1-7497-42d6-af7b-b50529f7e795 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:24.151733 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-1c0512a1-7497-42d6-af7b-b50529f7e795 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:24.153204 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-1c0512a1-7497-42d6-af7b-b50529f7e795 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:24.154354 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-1c0512a1-7497-42d6-af7b-b50529f7e795 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1720 microversion: 2.20 time: 0.152913 Oct 19 00:43:24.154902 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 258/543] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:24 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:43:24.159173 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-cd0e1325-802a-49ad-b7ff-67f661893609 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:24.159766 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-cd0e1325-802a-49ad-b7ff-67f661893609 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:24.166557 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cd0e1325-802a-49ad-b7ff-67f661893609 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:24.167014 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cd0e1325-802a-49ad-b7ff-67f661893609 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:24.167437 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cd0e1325-802a-49ad-b7ff-67f661893609 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:24.168173 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cd0e1325-802a-49ad-b7ff-67f661893609 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:24.168624 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cd0e1325-802a-49ad-b7ff-67f661893609 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:24.169038 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cd0e1325-802a-49ad-b7ff-67f661893609 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:24.306752 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-cd0e1325-802a-49ad-b7ff-67f661893609 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:24.316027 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-cd0e1325-802a-49ad-b7ff-67f661893609 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1725 microversion: 2.1 time: 0.160141 Oct 19 00:43:24.316587 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 259/544] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:24 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:25.007104 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-8b160424-c747-4b9e-a3a6-0eadd22d2b74 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:25.007706 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-8b160424-c747-4b9e-a3a6-0eadd22d2b74 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 04a968fc-e77d-4848-b28e-98db63fb2eea] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:25.014284 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8b160424-c747-4b9e-a3a6-0eadd22d2b74 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:25.014767 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8b160424-c747-4b9e-a3a6-0eadd22d2b74 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:25.015200 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8b160424-c747-4b9e-a3a6-0eadd22d2b74 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:25.015922 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8b160424-c747-4b9e-a3a6-0eadd22d2b74 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:25.016406 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8b160424-c747-4b9e-a3a6-0eadd22d2b74 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:25.016828 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8b160424-c747-4b9e-a3a6-0eadd22d2b74 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:25.145882 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-8b160424-c747-4b9e-a3a6-0eadd22d2b74 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:25.154039 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-8b160424-c747-4b9e-a3a6-0eadd22d2b74 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea" status: 200 len: 1514 microversion: 2.1 time: 0.151391 Oct 19 00:43:25.154615 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 260/545] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:25 2022] GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:43:25.179282 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-270c9405-3941-496b-a60b-0110e317b5c2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:25.179909 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-270c9405-3941-496b-a60b-0110e317b5c2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:25.185482 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-270c9405-3941-496b-a60b-0110e317b5c2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:25.185962 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-270c9405-3941-496b-a60b-0110e317b5c2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:25.186402 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-270c9405-3941-496b-a60b-0110e317b5c2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:25.187099 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-270c9405-3941-496b-a60b-0110e317b5c2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:25.187554 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-270c9405-3941-496b-a60b-0110e317b5c2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:25.188010 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-270c9405-3941-496b-a60b-0110e317b5c2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:25.317696 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-270c9405-3941-496b-a60b-0110e317b5c2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:25.326324 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-270c9405-3941-496b-a60b-0110e317b5c2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:25.327775 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-270c9405-3941-496b-a60b-0110e317b5c2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:25.329001 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-270c9405-3941-496b-a60b-0110e317b5c2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1720 microversion: 2.20 time: 0.153372 Oct 19 00:43:25.329548 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 261/546] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:25 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:43:25.339110 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-c8ceef33-122b-4f96-9588-d8e987618003 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:25.339737 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-c8ceef33-122b-4f96-9588-d8e987618003 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:25.345461 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c8ceef33-122b-4f96-9588-d8e987618003 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:25.345939 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c8ceef33-122b-4f96-9588-d8e987618003 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:25.346371 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c8ceef33-122b-4f96-9588-d8e987618003 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:25.347053 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c8ceef33-122b-4f96-9588-d8e987618003 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:25.347504 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c8ceef33-122b-4f96-9588-d8e987618003 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:25.347959 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c8ceef33-122b-4f96-9588-d8e987618003 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:25.485950 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-c8ceef33-122b-4f96-9588-d8e987618003 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:25.495089 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-c8ceef33-122b-4f96-9588-d8e987618003 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1725 microversion: 2.1 time: 0.160057 Oct 19 00:43:25.495658 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 262/547] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:25 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:43:26.060561 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-d7182a7b-682f-4889-aa05-b88080b86a6b tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "POST /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.948222 Oct 19 00:43:26.061393 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 286/548] 10.222.0.33 () {60 vars in 1323 bytes} [Wed Oct 19 00:43:19 2022] POST /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4/os-volume_attachments => generated 194 bytes in 6950 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:43:26.179112 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-1611f378-7e92-495e-8701-e7fc9329ae0e tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:26.180094 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-1611f378-7e92-495e-8701-e7fc9329ae0e tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 04a968fc-e77d-4848-b28e-98db63fb2eea] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:26.186459 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1611f378-7e92-495e-8701-e7fc9329ae0e tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:26.187234 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1611f378-7e92-495e-8701-e7fc9329ae0e tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:26.187680 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1611f378-7e92-495e-8701-e7fc9329ae0e tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:26.188479 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1611f378-7e92-495e-8701-e7fc9329ae0e tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:26.189111 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1611f378-7e92-495e-8701-e7fc9329ae0e tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:26.189537 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1611f378-7e92-495e-8701-e7fc9329ae0e tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:26.334640 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-1611f378-7e92-495e-8701-e7fc9329ae0e tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:26.345034 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-1611f378-7e92-495e-8701-e7fc9329ae0e tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea" status: 200 len: 1514 microversion: 2.1 time: 0.170093 Oct 19 00:43:26.345849 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 263/549] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:26 2022] GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:26.356301 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-26f9a945-6923-4e00-812c-e134ab857b37 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:26.357335 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-26f9a945-6923-4e00-812c-e134ab857b37 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:26.365982 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_api:SELECT=78 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:26.371432 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-26f9a945-6923-4e00-812c-e134ab857b37 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:26.372351 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-26f9a945-6923-4e00-812c-e134ab857b37 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:26.372789 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-26f9a945-6923-4e00-812c-e134ab857b37 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:26.373620 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-26f9a945-6923-4e00-812c-e134ab857b37 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:26.374077 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-26f9a945-6923-4e00-812c-e134ab857b37 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:26.374699 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-26f9a945-6923-4e00-812c-e134ab857b37 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:26.519531 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-a69e5044-2125-4ea5-a563-4d687e0e6436 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:26.520108 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-a69e5044-2125-4ea5-a563-4d687e0e6436 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:26.526624 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a69e5044-2125-4ea5-a563-4d687e0e6436 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:26.527103 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a69e5044-2125-4ea5-a563-4d687e0e6436 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:26.527534 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a69e5044-2125-4ea5-a563-4d687e0e6436 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:26.528250 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a69e5044-2125-4ea5-a563-4d687e0e6436 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:26.528700 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a69e5044-2125-4ea5-a563-4d687e0e6436 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:26.529113 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a69e5044-2125-4ea5-a563-4d687e0e6436 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:26.572505 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-26f9a945-6923-4e00-812c-e134ab857b37 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:26.581953 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-26f9a945-6923-4e00-812c-e134ab857b37 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:26.583638 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-26f9a945-6923-4e00-812c-e134ab857b37 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:26.584834 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-26f9a945-6923-4e00-812c-e134ab857b37 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1723 microversion: 2.20 time: 0.233921 Oct 19 00:43:26.586279 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 287/550] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:26 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:26.610326 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-12b2b8ec-d052-4981-ac9e-2fa2eac02f5c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4aa8f415-2bce-4c42-9d74-4712c53a9362"}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:43:26.613487 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-12b2b8ec-d052-4981-ac9e-2fa2eac02f5c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:26.639015 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-12b2b8ec-d052-4981-ac9e-2fa2eac02f5c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:26.639610 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-12b2b8ec-d052-4981-ac9e-2fa2eac02f5c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:26.640152 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-12b2b8ec-d052-4981-ac9e-2fa2eac02f5c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:26.641552 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-12b2b8ec-d052-4981-ac9e-2fa2eac02f5c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:26.643104 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-12b2b8ec-d052-4981-ac9e-2fa2eac02f5c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:26.643838 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-12b2b8ec-d052-4981-ac9e-2fa2eac02f5c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:26.681780 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-a69e5044-2125-4ea5-a563-4d687e0e6436 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:26.690477 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-a69e5044-2125-4ea5-a563-4d687e0e6436 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1702 microversion: 2.1 time: 0.174887 Oct 19 00:43:26.691023 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 264/551] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:26 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1702 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:43:26.696685 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-50be5ef7-a11d-4b45-8f93-621afdd494be req-30181a83-f1a0-445a-847c-13312eae8e2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04a968fc-e77d-4848-b28e-98db63fb2eea", "name": "network-vif-deleted", "tag": "29a45cb5-35ee-492e-aac3-5d7950d34482"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:43:26.706730 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-50be5ef7-a11d-4b45-8f93-621afdd494be req-30181a83-f1a0-445a-847c-13312eae8e2c service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:26.708254 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-50be5ef7-a11d-4b45-8f93-621afdd494be req-30181a83-f1a0-445a-847c-13312eae8e2c service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:26.708950 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-50be5ef7-a11d-4b45-8f93-621afdd494be req-30181a83-f1a0-445a-847c-13312eae8e2c service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:26.721124 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-50be5ef7-a11d-4b45-8f93-621afdd494be req-30181a83-f1a0-445a-847c-13312eae8e2c service nova] Creating event network-vif-deleted:29a45cb5-35ee-492e-aac3-5d7950d34482 for instance 04a968fc-e77d-4848-b28e-98db63fb2eea on hv-cinder-maste Oct 19 00:43:26.726451 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-50be5ef7-a11d-4b45-8f93-621afdd494be req-30181a83-f1a0-445a-847c-13312eae8e2c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034019 Oct 19 00:43:26.727036 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 265/552] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:43:26.732391 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-973042e0-c411-43ab-8386-51ba5a9e7508 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:43:26.738710 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-973042e0-c411-43ab-8386-51ba5a9e7508 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:26.739249 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-973042e0-c411-43ab-8386-51ba5a9e7508 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:26.739828 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-973042e0-c411-43ab-8386-51ba5a9e7508 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:26.763898 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-973042e0-c411-43ab-8386-51ba5a9e7508 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Going to try to start instance {{(pid=125531) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 19 00:43:26.788435 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:26.809056 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-973042e0-c411-43ab-8386-51ba5a9e7508 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "POST /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654/action" status: 202 len: 0 microversion: 2.1 time: 0.080472 Oct 19 00:43:26.809659 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 266/553] 10.222.0.33 () {60 vars in 1278 bytes} [Wed Oct 19 00:43:26 2022] POST /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:43:26.818111 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-ba94d7e5-bdac-4ac1-9dde-7eef7e9054a8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:26.818814 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-ba94d7e5-bdac-4ac1-9dde-7eef7e9054a8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:26.822351 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:26.826654 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ba94d7e5-bdac-4ac1-9dde-7eef7e9054a8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:26.827174 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ba94d7e5-bdac-4ac1-9dde-7eef7e9054a8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:26.827683 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ba94d7e5-bdac-4ac1-9dde-7eef7e9054a8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:26.828494 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ba94d7e5-bdac-4ac1-9dde-7eef7e9054a8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:26.828968 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ba94d7e5-bdac-4ac1-9dde-7eef7e9054a8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:26.829433 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ba94d7e5-bdac-4ac1-9dde-7eef7e9054a8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:26.961157 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-12b2b8ec-d052-4981-ac9e-2fa2eac02f5c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "POST /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.354725 Oct 19 00:43:26.961816 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 288/554] 10.222.0.33 () {62 vars in 1364 bytes} [Wed Oct 19 00:43:26 2022] POST /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2/os-volume_attachments => generated 188 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 00:43:26.971939 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-ba94d7e5-bdac-4ac1-9dde-7eef7e9054a8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:26.981285 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-ba94d7e5-bdac-4ac1-9dde-7eef7e9054a8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1711 microversion: 2.1 time: 0.167120 Oct 19 00:43:26.982013 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 267/555] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:26 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1711 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:43:27.092785 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-7bc381b2-95ca-4fe8-af59-b69694d48375 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:43:27.093385 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-7bc381b2-95ca-4fe8-af59-b69694d48375 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:27.099244 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7bc381b2-95ca-4fe8-af59-b69694d48375 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:27.099727 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7bc381b2-95ca-4fe8-af59-b69694d48375 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:27.100200 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7bc381b2-95ca-4fe8-af59-b69694d48375 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:27.101541 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7bc381b2-95ca-4fe8-af59-b69694d48375 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:27.101999 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7bc381b2-95ca-4fe8-af59-b69694d48375 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:27.102421 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7bc381b2-95ca-4fe8-af59-b69694d48375 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:27.144545 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-7bc381b2-95ca-4fe8-af59-b69694d48375 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125532) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 19 00:43:27.214959 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-7bc381b2-95ca-4fe8-af59-b69694d48375 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "POST /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2/action" status: 202 len: 0 microversion: 2.20 time: 0.126013 Oct 19 00:43:27.215559 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 289/556] 10.222.0.33 () {62 vars in 1319 bytes} [Wed Oct 19 00:43:27 2022] POST /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:43:27.223706 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-0a69bc1a-4507-41e2-b6ef-3d5b68d501a9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:27.224456 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-0a69bc1a-4507-41e2-b6ef-3d5b68d501a9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:27.231904 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0a69bc1a-4507-41e2-b6ef-3d5b68d501a9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:27.232328 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0a69bc1a-4507-41e2-b6ef-3d5b68d501a9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:27.232757 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0a69bc1a-4507-41e2-b6ef-3d5b68d501a9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:27.233440 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0a69bc1a-4507-41e2-b6ef-3d5b68d501a9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:27.233912 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0a69bc1a-4507-41e2-b6ef-3d5b68d501a9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:27.234325 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0a69bc1a-4507-41e2-b6ef-3d5b68d501a9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:27.261300 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell0:SELECT=2 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:27.372075 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-73c95ef7-84b5-49c4-bed1-a919931e92ec tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:27.372985 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-73c95ef7-84b5-49c4-bed1-a919931e92ec tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 04a968fc-e77d-4848-b28e-98db63fb2eea] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:27.377989 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-0a69bc1a-4507-41e2-b6ef-3d5b68d501a9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:27.379668 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-73c95ef7-84b5-49c4-bed1-a919931e92ec tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:27.380191 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-73c95ef7-84b5-49c4-bed1-a919931e92ec tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:27.380624 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-73c95ef7-84b5-49c4-bed1-a919931e92ec tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:27.381312 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-73c95ef7-84b5-49c4-bed1-a919931e92ec tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:27.381911 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-73c95ef7-84b5-49c4-bed1-a919931e92ec tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:27.382504 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-73c95ef7-84b5-49c4-bed1-a919931e92ec tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:27.398582 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-0a69bc1a-4507-41e2-b6ef-3d5b68d501a9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:27.400342 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-0a69bc1a-4507-41e2-b6ef-3d5b68d501a9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:27.404228 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-0a69bc1a-4507-41e2-b6ef-3d5b68d501a9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1809 microversion: 2.20 time: 0.184352 Oct 19 00:43:27.404957 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 268/557] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:27 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:27.457914 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-73c95ef7-84b5-49c4-bed1-a919931e92ec tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:27.473572 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-73c95ef7-84b5-49c4-bed1-a919931e92ec tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea" status: 200 len: 1472 microversion: 2.1 time: 0.107823 Oct 19 00:43:27.474680 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 290/558] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:27 2022] GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea => generated 1472 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:43:28.004829 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-767d7f68-1289-4de5-ad30-2d6ac7462c56 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:28.005763 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-767d7f68-1289-4de5-ad30-2d6ac7462c56 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:28.012068 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-767d7f68-1289-4de5-ad30-2d6ac7462c56 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:28.012561 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-767d7f68-1289-4de5-ad30-2d6ac7462c56 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:28.012993 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-767d7f68-1289-4de5-ad30-2d6ac7462c56 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:28.013690 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-767d7f68-1289-4de5-ad30-2d6ac7462c56 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:28.014193 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-767d7f68-1289-4de5-ad30-2d6ac7462c56 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:28.015142 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-767d7f68-1289-4de5-ad30-2d6ac7462c56 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:28.226773 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-767d7f68-1289-4de5-ad30-2d6ac7462c56 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:28.235845 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-767d7f68-1289-4de5-ad30-2d6ac7462c56 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1711 microversion: 2.1 time: 0.235000 Oct 19 00:43:28.236600 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 269/559] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:27 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1711 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:28.436930 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-24bd1e6e-4493-4bac-a9b6-767494ba44a5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:28.438148 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-24bd1e6e-4493-4bac-a9b6-767494ba44a5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:28.446509 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-24bd1e6e-4493-4bac-a9b6-767494ba44a5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:28.446702 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-765ba3c7-d8ab-41e2-8e99-127f6a5a916d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:28.448832 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-765ba3c7-d8ab-41e2-8e99-127f6a5a916d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:28.449345 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-24bd1e6e-4493-4bac-a9b6-767494ba44a5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:28.450632 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-24bd1e6e-4493-4bac-a9b6-767494ba44a5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:28.452112 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-24bd1e6e-4493-4bac-a9b6-767494ba44a5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:28.453079 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-24bd1e6e-4493-4bac-a9b6-767494ba44a5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:28.453666 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-24bd1e6e-4493-4bac-a9b6-767494ba44a5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:28.455718 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-765ba3c7-d8ab-41e2-8e99-127f6a5a916d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:28.456413 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-765ba3c7-d8ab-41e2-8e99-127f6a5a916d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:28.457028 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-765ba3c7-d8ab-41e2-8e99-127f6a5a916d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:28.457896 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-765ba3c7-d8ab-41e2-8e99-127f6a5a916d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:28.458456 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-765ba3c7-d8ab-41e2-8e99-127f6a5a916d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:28.458968 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-765ba3c7-d8ab-41e2-8e99-127f6a5a916d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:28.594549 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-24bd1e6e-4493-4bac-a9b6-767494ba44a5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:28.597500 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-765ba3c7-d8ab-41e2-8e99-127f6a5a916d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:28.604122 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-24bd1e6e-4493-4bac-a9b6-767494ba44a5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:28.605560 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-24bd1e6e-4493-4bac-a9b6-767494ba44a5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:28.606479 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-765ba3c7-d8ab-41e2-8e99-127f6a5a916d tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1594 microversion: 2.1 time: 0.165827 Oct 19 00:43:28.606744 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-24bd1e6e-4493-4bac-a9b6-767494ba44a5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1751 microversion: 2.20 time: 0.176251 Oct 19 00:43:28.620084 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 270/560] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:28 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1594 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:43:28.620084 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-b88a66ac-63f8-4902-abe2-053191e15c00 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:28.620084 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-b88a66ac-63f8-4902-abe2-053191e15c00 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 04a968fc-e77d-4848-b28e-98db63fb2eea] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:28.620084 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b88a66ac-63f8-4902-abe2-053191e15c00 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:28.620513 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b88a66ac-63f8-4902-abe2-053191e15c00 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:28.620724 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b88a66ac-63f8-4902-abe2-053191e15c00 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:28.621863 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b88a66ac-63f8-4902-abe2-053191e15c00 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:28.622476 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b88a66ac-63f8-4902-abe2-053191e15c00 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:28.623057 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b88a66ac-63f8-4902-abe2-053191e15c00 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:28.623806 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 291/561] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:28 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1751 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:28.657810 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b88a66ac-63f8-4902-abe2-053191e15c00 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:28.658365 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b88a66ac-63f8-4902-abe2-053191e15c00 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:28.658881 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b88a66ac-63f8-4902-abe2-053191e15c00 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:28.659405 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.objects.instance [None req-b88a66ac-63f8-4902-abe2-053191e15c00 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lazy-loading 'fault' on Instance uuid 04a968fc-e77d-4848-b28e-98db63fb2eea {{(pid=125531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:43:28.711721 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-b88a66ac-63f8-4902-abe2-053191e15c00 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:28.719622 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-b88a66ac-63f8-4902-abe2-053191e15c00 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea" status: 200 len: 1309 microversion: 2.1 time: 0.111625 Oct 19 00:43:28.720227 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 271/562] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:28 2022] GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea => generated 1309 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:29.261911 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-d7a444ab-0175-4f70-bd5f-55581535e1ee tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:29.262617 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-d7a444ab-0175-4f70-bd5f-55581535e1ee tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:29.270664 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d7a444ab-0175-4f70-bd5f-55581535e1ee tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:29.271334 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d7a444ab-0175-4f70-bd5f-55581535e1ee tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:29.272110 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d7a444ab-0175-4f70-bd5f-55581535e1ee tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:29.272880 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d7a444ab-0175-4f70-bd5f-55581535e1ee tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:29.273637 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d7a444ab-0175-4f70-bd5f-55581535e1ee tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:29.274263 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d7a444ab-0175-4f70-bd5f-55581535e1ee tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:29.420661 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-d7a444ab-0175-4f70-bd5f-55581535e1ee tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:29.429042 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-d7a444ab-0175-4f70-bd5f-55581535e1ee tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1711 microversion: 2.1 time: 0.171690 Oct 19 00:43:29.430408 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 292/563] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:29 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1711 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:29.633496 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-6755b2d0-1eda-4c25-819f-a0d8d8e304fb tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:29.634129 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-6755b2d0-1eda-4c25-819f-a0d8d8e304fb tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:29.640403 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6755b2d0-1eda-4c25-819f-a0d8d8e304fb tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:29.640882 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6755b2d0-1eda-4c25-819f-a0d8d8e304fb tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:29.641310 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6755b2d0-1eda-4c25-819f-a0d8d8e304fb tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:29.641998 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6755b2d0-1eda-4c25-819f-a0d8d8e304fb tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:29.642485 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6755b2d0-1eda-4c25-819f-a0d8d8e304fb tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:29.642903 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6755b2d0-1eda-4c25-819f-a0d8d8e304fb tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:29.747192 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-8c704d43-fe82-4d8e-9c16-2ba292eda253 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:29.748438 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-8c704d43-fe82-4d8e-9c16-2ba292eda253 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 04a968fc-e77d-4848-b28e-98db63fb2eea] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:29.756666 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8c704d43-fe82-4d8e-9c16-2ba292eda253 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:29.757921 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8c704d43-fe82-4d8e-9c16-2ba292eda253 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:29.757921 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8c704d43-fe82-4d8e-9c16-2ba292eda253 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:29.758811 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8c704d43-fe82-4d8e-9c16-2ba292eda253 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:29.759349 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8c704d43-fe82-4d8e-9c16-2ba292eda253 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:29.759874 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8c704d43-fe82-4d8e-9c16-2ba292eda253 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:29.778019 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.wsgi [None req-8c704d43-fe82-4d8e-9c16-2ba292eda253 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] HTTP exception thrown: Instance 04a968fc-e77d-4848-b28e-98db63fb2eea could not be found. Oct 19 00:43:29.779705 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-8c704d43-fe82-4d8e-9c16-2ba292eda253 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Request method failure captured: Oct 19 00:43:29.779705 dv-cinder-master-3-smb devstack@n-api.service[125532]: request: GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea HTTP/1.1 Oct 19 00:43:29.779705 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept: application/json Oct 19 00:43:29.779705 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept-Encoding: identity Oct 19 00:43:29.779705 dv-cinder-master-3-smb devstack@n-api.service[125532]: Connection: close Oct 19 00:43:29.779705 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Length: 0 Oct 19 00:43:29.779705 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Type: application/json Oct 19 00:43:29.779705 dv-cinder-master-3-smb devstack@n-api.service[125532]: Host: 10.222.0.33 Oct 19 00:43:29.779705 dv-cinder-master-3-smb devstack@n-api.service[125532]: Openstack-System-Scope: None Oct 19 00:43:29.779705 dv-cinder-master-3-smb devstack@n-api.service[125532]: User-Agent: python-urllib3/1.26.12 Oct 19 00:43:29.779705 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Auth-Token: gAAAAABjT0fIlnlAjgiUNTzu88rFt85fe39D8Pklz9QJEAoNGsXRuuTB9wKhzgQE3FhRultcU3Cw-cFvapTBojzVSw9lyJNAipNyoCjtbYUlq7QjmDRnS9vmi3OzfiyulnLIH5t3dcmklnLwjruy65RLWBlzUfJI5VtIdvqS8w3yHz8QFzoK7I0 Oct 19 00:43:29.779705 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Id: None Oct 19 00:43:29.779705 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Name: None Oct 19 00:43:29.779705 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Identity-Status: Confirmed Oct 19 00:43:29.779705 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Is-Admin-Project: True Oct 19 00:43:29.779705 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Id: default Oct 19 00:43:29.779705 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Name: Default Oct 19 00:43:29.779705 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Id: 3b24d4afc5104b359924acdf4619cfc7 Oct 19 00:43:29.779705 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1763949199 Oct 19 00:43:29.779705 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Role: member,reader Oct 19 00:43:29.779705 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Roles: member,reader Oct 19 00:43:29.781397 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3b24d4afc5104b359924acdf4619cfc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b24d4afc5104b359924acdf4619cfc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3b24d4afc5104b359924acdf4619cfc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b24d4afc5104b359924acdf4619cfc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:43:29.781397 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant: tempest-VolumesSnapshotTestJSON-1763949199 Oct 19 00:43:29.781397 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Id: 3b24d4afc5104b359924acdf4619cfc7 Oct 19 00:43:29.781397 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1763949199 Oct 19 00:43:29.781397 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User: tempest-VolumesSnapshotTestJSON-1763949199-project Oct 19 00:43:29.781397 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Id: default Oct 19 00:43:29.781397 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Name: Default Oct 19 00:43:29.781397 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Id: bb1e83f51a384b7d9d044bce87f00990 Oct 19 00:43:29.781397 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Name: tempest-VolumesSnapshotTestJSON-1763949199-project Oct 19 00:43:29.781397 dv-cinder-master-3-smb devstack@n-api.service[125532]: method: > Oct 19 00:43:29.781397 dv-cinder-master-3-smb devstack@n-api.service[125532]: exception: Instance 04a968fc-e77d-4848-b28e-98db63fb2eea could not be found. Oct 19 00:43:29.781397 dv-cinder-master-3-smb devstack@n-api.service[125532]: action_args: {'id': '04a968fc-e77d-4848-b28e-98db63fb2eea'} Oct 19 00:43:29.782317 dv-cinder-master-3-smb devstack@n-api.service[125532]: {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:43:29.782317 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:43:29.782317 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:43:29.782317 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:43:29.782317 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:43:29.782317 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:43:29.782317 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:43:29.782317 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:43:29.782317 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:43:29.782317 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:43:29.782317 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04a968fc-e77d-4848-b28e-98db63fb2eea could not be found. Oct 19 00:43:29.782317 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:43:29.782317 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:43:29.782317 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:43:29.782317 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:43:29.782317 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:43:29.782317 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:43:29.782317 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:43:29.782317 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:43:29.782317 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:43:29.783585 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:43:29.783585 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:43:29.783585 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:43:29.783585 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:43:29.783585 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:43:29.783585 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:43:29.783585 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:43:29.783585 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04a968fc-e77d-4848-b28e-98db63fb2eea could not be found. Oct 19 00:43:29.783585 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:43:29.783585 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:43:29.783585 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:43:29.783585 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:43:29.783585 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:43:29.783585 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:43:29.783585 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:43:29.783585 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:43:29.783585 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04a968fc-e77d-4848-b28e-98db63fb2eea could not be found. Oct 19 00:43:29.783585 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:43:29.785657 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-8c704d43-fe82-4d8e-9c16-2ba292eda253 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Returning 404 to user: Instance 04a968fc-e77d-4848-b28e-98db63fb2eea could not be found. {{(pid=125532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:43:29.785657 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-8c704d43-fe82-4d8e-9c16-2ba292eda253 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea" status: 404 len: 111 microversion: 2.1 time: 0.042378 Oct 19 00:43:29.785657 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 293/564] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:29 2022] GET /compute/v2.1/servers/04a968fc-e77d-4848-b28e-98db63fb2eea => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 00:43:29.862443 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-6755b2d0-1eda-4c25-819f-a0d8d8e304fb tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:29.874107 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-6755b2d0-1eda-4c25-819f-a0d8d8e304fb tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:29.876406 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-6755b2d0-1eda-4c25-819f-a0d8d8e304fb tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:29.878171 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-6755b2d0-1eda-4c25-819f-a0d8d8e304fb tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1807 microversion: 2.20 time: 0.248798 Oct 19 00:43:29.878882 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 272/565] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:29 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1807 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:30.454189 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-8b2efb05-a216-453f-b5d1-5dc8d8d95070 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:30.455290 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-8b2efb05-a216-453f-b5d1-5dc8d8d95070 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:30.463108 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8b2efb05-a216-453f-b5d1-5dc8d8d95070 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:30.464016 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8b2efb05-a216-453f-b5d1-5dc8d8d95070 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:30.464501 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8b2efb05-a216-453f-b5d1-5dc8d8d95070 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:30.465312 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8b2efb05-a216-453f-b5d1-5dc8d8d95070 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:30.465653 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8b2efb05-a216-453f-b5d1-5dc8d8d95070 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:30.466233 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8b2efb05-a216-453f-b5d1-5dc8d8d95070 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:30.605187 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-8b2efb05-a216-453f-b5d1-5dc8d8d95070 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:30.613763 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-8b2efb05-a216-453f-b5d1-5dc8d8d95070 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1715 microversion: 2.1 time: 0.163718 Oct 19 00:43:30.614540 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 294/566] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:30 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1715 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:30.680322 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-80b4732f-64fe-46e9-a661-3182c4ba0277 req-c6cd7ec8-8fb2-4bbc-bb60-81176f220b1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09190732-7307-4684-a264-9b5b31301df4", "tag": "c199c72b-1e56-47e2-b8a5-93c07ba36102"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:43:30.690146 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-80b4732f-64fe-46e9-a661-3182c4ba0277 req-c6cd7ec8-8fb2-4bbc-bb60-81176f220b1c service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:30.690835 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-80b4732f-64fe-46e9-a661-3182c4ba0277 req-c6cd7ec8-8fb2-4bbc-bb60-81176f220b1c service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:30.691442 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-80b4732f-64fe-46e9-a661-3182c4ba0277 req-c6cd7ec8-8fb2-4bbc-bb60-81176f220b1c service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:30.703809 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-80b4732f-64fe-46e9-a661-3182c4ba0277 req-c6cd7ec8-8fb2-4bbc-bb60-81176f220b1c service nova] Creating event network-changed:c199c72b-1e56-47e2-b8a5-93c07ba36102 for instance 09190732-7307-4684-a264-9b5b31301df4 on hv-cinder-maste Oct 19 00:43:30.708864 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-80b4732f-64fe-46e9-a661-3182c4ba0277 req-c6cd7ec8-8fb2-4bbc-bb60-81176f220b1c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033084 Oct 19 00:43:30.709508 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 273/567] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:43:30.907292 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-977278f3-ce20-46e1-a312-dd7cfdc360f6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:30.907933 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-977278f3-ce20-46e1-a312-dd7cfdc360f6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:30.924593 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-977278f3-ce20-46e1-a312-dd7cfdc360f6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:30.925497 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-977278f3-ce20-46e1-a312-dd7cfdc360f6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:30.926103 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-977278f3-ce20-46e1-a312-dd7cfdc360f6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:30.928952 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-977278f3-ce20-46e1-a312-dd7cfdc360f6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:30.930841 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-977278f3-ce20-46e1-a312-dd7cfdc360f6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:30.931653 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-977278f3-ce20-46e1-a312-dd7cfdc360f6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:31.158609 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-977278f3-ce20-46e1-a312-dd7cfdc360f6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:31.176289 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-977278f3-ce20-46e1-a312-dd7cfdc360f6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:31.183442 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-977278f3-ce20-46e1-a312-dd7cfdc360f6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:31.184755 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-977278f3-ce20-46e1-a312-dd7cfdc360f6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1807 microversion: 2.20 time: 0.281392 Oct 19 00:43:31.185552 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 295/568] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:30 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1807 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:32.167438 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-4da5c2a1-d9da-48a8-8450-c821ef7ab552 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1176245002"}} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:43:32.168092 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-4da5c2a1-d9da-48a8-8450-c821ef7ab552 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:32.174692 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4da5c2a1-d9da-48a8-8450-c821ef7ab552 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:32.175212 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4da5c2a1-d9da-48a8-8450-c821ef7ab552 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:32.175647 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4da5c2a1-d9da-48a8-8450-c821ef7ab552 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:32.176394 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4da5c2a1-d9da-48a8-8450-c821ef7ab552 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:32.176850 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4da5c2a1-d9da-48a8-8450-c821ef7ab552 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:32.177274 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4da5c2a1-d9da-48a8-8450-c821ef7ab552 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:32.211087 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-6378798b-a439-40ae-8252-83c1cdbe6877 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:32.212013 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-6378798b-a439-40ae-8252-83c1cdbe6877 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:32.221593 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6378798b-a439-40ae-8252-83c1cdbe6877 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:32.222133 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6378798b-a439-40ae-8252-83c1cdbe6877 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:32.222473 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6378798b-a439-40ae-8252-83c1cdbe6877 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:32.223174 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6378798b-a439-40ae-8252-83c1cdbe6877 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:32.223623 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6378798b-a439-40ae-8252-83c1cdbe6877 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:32.224079 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6378798b-a439-40ae-8252-83c1cdbe6877 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:32.229662 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:32.347297 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.network.security_group_api [None req-4da5c2a1-d9da-48a8-8450-c821ef7ab552 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Adding security group 94d61f9d-564e-4042-9c87-019a901b4b14 to port c199c72b-1e56-47e2-b8a5-93c07ba36102 Oct 19 00:43:32.385634 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-6378798b-a439-40ae-8252-83c1cdbe6877 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:32.396024 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-6378798b-a439-40ae-8252-83c1cdbe6877 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:32.398634 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-6378798b-a439-40ae-8252-83c1cdbe6877 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:32.400012 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-6378798b-a439-40ae-8252-83c1cdbe6877 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1807 microversion: 2.20 time: 0.193318 Oct 19 00:43:32.413966 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 296/569] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:32 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:32.832871 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-4da5c2a1-d9da-48a8-8450-c821ef7ab552 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "POST /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4/action" status: 202 len: 0 microversion: 2.1 time: 0.670594 Oct 19 00:43:32.833763 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 274/570] 10.222.0.33 () {60 vars in 1278 bytes} [Wed Oct 19 00:43:32 2022] POST /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4/action => generated 0 bytes in 673 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:43:32.842602 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-699fc50a-870f-450f-9a6c-962e38fa8109 req-7d3fd026-1519-42c4-b99d-8e29cfd5e27e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09190732-7307-4684-a264-9b5b31301df4", "tag": "c199c72b-1e56-47e2-b8a5-93c07ba36102"}]} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:43:32.849729 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-2b9fbf07-fa0f-4349-a191-5782cf04a23f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:32.850286 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-2b9fbf07-fa0f-4349-a191-5782cf04a23f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:32.853259 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-699fc50a-870f-450f-9a6c-962e38fa8109 req-7d3fd026-1519-42c4-b99d-8e29cfd5e27e service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:32.853923 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-699fc50a-870f-450f-9a6c-962e38fa8109 req-7d3fd026-1519-42c4-b99d-8e29cfd5e27e service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:32.854504 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-699fc50a-870f-450f-9a6c-962e38fa8109 req-7d3fd026-1519-42c4-b99d-8e29cfd5e27e service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:32.874272 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2b9fbf07-fa0f-4349-a191-5782cf04a23f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:32.874683 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.compute.server_external_events [req-699fc50a-870f-450f-9a6c-962e38fa8109 req-7d3fd026-1519-42c4-b99d-8e29cfd5e27e service nova] Creating event network-changed:c199c72b-1e56-47e2-b8a5-93c07ba36102 for instance 09190732-7307-4684-a264-9b5b31301df4 on hv-cinder-maste Oct 19 00:43:32.879316 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2b9fbf07-fa0f-4349-a191-5782cf04a23f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:32.880013 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-699fc50a-870f-450f-9a6c-962e38fa8109 req-7d3fd026-1519-42c4-b99d-8e29cfd5e27e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040816 Oct 19 00:43:32.880154 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2b9fbf07-fa0f-4349-a191-5782cf04a23f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:32.880779 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2b9fbf07-fa0f-4349-a191-5782cf04a23f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:32.881060 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 297/571] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:43:32.881241 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2b9fbf07-fa0f-4349-a191-5782cf04a23f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:32.881673 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2b9fbf07-fa0f-4349-a191-5782cf04a23f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:33.083376 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-2b9fbf07-fa0f-4349-a191-5782cf04a23f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:33.094400 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-2b9fbf07-fa0f-4349-a191-5782cf04a23f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1759 microversion: 2.1 time: 0.248362 Oct 19 00:43:33.112173 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 275/572] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:32 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1759 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:33.427604 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-bf4f797e-5658-4b60-a9d5-38ea7d417a42 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:33.428977 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-bf4f797e-5658-4b60-a9d5-38ea7d417a42 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:33.436083 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-bf4f797e-5658-4b60-a9d5-38ea7d417a42 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:33.436792 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-bf4f797e-5658-4b60-a9d5-38ea7d417a42 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:33.437404 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-bf4f797e-5658-4b60-a9d5-38ea7d417a42 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:33.438263 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-bf4f797e-5658-4b60-a9d5-38ea7d417a42 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:33.438875 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-bf4f797e-5658-4b60-a9d5-38ea7d417a42 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:33.439463 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-bf4f797e-5658-4b60-a9d5-38ea7d417a42 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:33.579709 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-bf4f797e-5658-4b60-a9d5-38ea7d417a42 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:33.588900 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-bf4f797e-5658-4b60-a9d5-38ea7d417a42 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:33.590367 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-bf4f797e-5658-4b60-a9d5-38ea7d417a42 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:33.591519 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-bf4f797e-5658-4b60-a9d5-38ea7d417a42 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1807 microversion: 2.20 time: 0.168748 Oct 19 00:43:33.592111 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 298/573] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:33 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:33.807109 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-bd06d3d9-f4d1-4572-a51e-038193d174ed tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1351322539", "imageRef": "d1f4abc9-3bb9-4343-9a05-53d758070c9d", "flavorRef": "452", "networks": [{"uuid": "7717f719-24dc-492e-93d6-b020602becc4"}]}} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:43:33.867666 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.network.neutron [None req-bd06d3d9-f4d1-4572-a51e-038193d174ed tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] validate_networks() for [('7717f719-24dc-492e-93d6-b020602becc4', None, None, None, None, None)] {{(pid=125531) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:43:34.240896 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-bd06d3d9-f4d1-4572-a51e-038193d174ed tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Flavor limits 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:43:34.241347 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-bd06d3d9-f4d1-4572-a51e-038193d174ed tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Image limits 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:43:34.242439 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-bd06d3d9-f4d1-4572-a51e-038193d174ed tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Flavor pref 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:43:34.243175 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-bd06d3d9-f4d1-4572-a51e-038193d174ed tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Image pref 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:43:34.243899 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-bd06d3d9-f4d1-4572-a51e-038193d174ed tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:43:34.255476 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bd06d3d9-f4d1-4572-a51e-038193d174ed tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:34.256418 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bd06d3d9-f4d1-4572-a51e-038193d174ed tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:34.257893 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bd06d3d9-f4d1-4572-a51e-038193d174ed tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:34.259128 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bd06d3d9-f4d1-4572-a51e-038193d174ed tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:34.259736 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bd06d3d9-f4d1-4572-a51e-038193d174ed tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:34.260393 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bd06d3d9-f4d1-4572-a51e-038193d174ed tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:34.278771 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.quota [None req-bd06d3d9-f4d1-4572-a51e-038193d174ed tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Getting quotas for project 3b24d4afc5104b359924acdf4619cfc7. Resources: {'instances', 'cores', 'ram'} {{(pid=125531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:43:34.282745 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.quota [None req-bd06d3d9-f4d1-4572-a51e-038193d174ed tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Getting quotas for user bb1e83f51a384b7d9d044bce87f00990 and project 3b24d4afc5104b359924acdf4619cfc7. Resources: {'instances', 'cores', 'ram'} {{(pid=125531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:43:34.295306 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-bd06d3d9-f4d1-4572-a51e-038193d174ed tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Going to run 1 instances... {{(pid=125531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:43:34.299695 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-bd06d3d9-f4d1-4572-a51e-038193d174ed tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1f4abc9-3bb9-4343-9a05-53d758070c9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:43:34.349812 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-bd06d3d9-f4d1-4572-a51e-038193d174ed tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.546979 Oct 19 00:43:34.351020 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 276/574] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Oct 19 00:43:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:43:34.362354 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-7e8de707-7321-44e4-a476-380819ce0b1d tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:34.363222 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-7e8de707-7321-44e4-a476-380819ce0b1d tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:34.422585 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-7e8de707-7321-44e4-a476-380819ce0b1d tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:34.431829 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-7e8de707-7321-44e4-a476-380819ce0b1d tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1219 microversion: 2.1 time: 0.073276 Oct 19 00:43:34.433560 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 299/575] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:34 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:34.625930 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-e780e440-7493-47a5-8934-3fc4b5854073 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:34.626762 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-e780e440-7493-47a5-8934-3fc4b5854073 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:34.633489 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e780e440-7493-47a5-8934-3fc4b5854073 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:34.634215 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e780e440-7493-47a5-8934-3fc4b5854073 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:34.634844 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e780e440-7493-47a5-8934-3fc4b5854073 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:34.635717 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e780e440-7493-47a5-8934-3fc4b5854073 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:34.636366 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e780e440-7493-47a5-8934-3fc4b5854073 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:34.636952 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e780e440-7493-47a5-8934-3fc4b5854073 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:34.799972 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-e780e440-7493-47a5-8934-3fc4b5854073 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:34.810643 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-e780e440-7493-47a5-8934-3fc4b5854073 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:34.813210 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-e780e440-7493-47a5-8934-3fc4b5854073 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:34.814484 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-e780e440-7493-47a5-8934-3fc4b5854073 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1807 microversion: 2.20 time: 0.199343 Oct 19 00:43:34.815128 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 277/576] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:34 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1807 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:35.457833 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-78f1b3f8-cd67-4110-8e74-8e38fd1a347c tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:35.458538 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-78f1b3f8-cd67-4110-8e74-8e38fd1a347c tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:35.466591 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-78f1b3f8-cd67-4110-8e74-8e38fd1a347c tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:35.467166 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-78f1b3f8-cd67-4110-8e74-8e38fd1a347c tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:35.467674 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-78f1b3f8-cd67-4110-8e74-8e38fd1a347c tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:35.468603 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-78f1b3f8-cd67-4110-8e74-8e38fd1a347c tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:35.469131 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-78f1b3f8-cd67-4110-8e74-8e38fd1a347c tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:35.469631 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-78f1b3f8-cd67-4110-8e74-8e38fd1a347c tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:35.531732 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-78f1b3f8-cd67-4110-8e74-8e38fd1a347c tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:35.539772 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-78f1b3f8-cd67-4110-8e74-8e38fd1a347c tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1223 microversion: 2.1 time: 0.085821 Oct 19 00:43:35.540368 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 300/577] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:35 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:35.840571 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-c10c0c30-3c40-490c-bd6d-3466f7969101 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:35.841413 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-c10c0c30-3c40-490c-bd6d-3466f7969101 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:35.848649 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c10c0c30-3c40-490c-bd6d-3466f7969101 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:35.849195 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c10c0c30-3c40-490c-bd6d-3466f7969101 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:35.849775 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c10c0c30-3c40-490c-bd6d-3466f7969101 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:35.850520 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c10c0c30-3c40-490c-bd6d-3466f7969101 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:35.851073 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c10c0c30-3c40-490c-bd6d-3466f7969101 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:35.852185 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c10c0c30-3c40-490c-bd6d-3466f7969101 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:35.997954 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-c10c0c30-3c40-490c-bd6d-3466f7969101 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:36.015366 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-c10c0c30-3c40-490c-bd6d-3466f7969101 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:36.017020 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-c10c0c30-3c40-490c-bd6d-3466f7969101 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:36.018333 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-c10c0c30-3c40-490c-bd6d-3466f7969101 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1807 microversion: 2.20 time: 0.182070 Oct 19 00:43:36.018910 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 278/578] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:35 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:36.562889 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-feab12ce-b581-4c71-92fb-27f02bdd5407 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:36.563529 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-feab12ce-b581-4c71-92fb-27f02bdd5407 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:36.570401 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-feab12ce-b581-4c71-92fb-27f02bdd5407 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:36.571037 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-feab12ce-b581-4c71-92fb-27f02bdd5407 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:36.571473 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-feab12ce-b581-4c71-92fb-27f02bdd5407 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:36.572198 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-feab12ce-b581-4c71-92fb-27f02bdd5407 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:36.572651 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-feab12ce-b581-4c71-92fb-27f02bdd5407 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:36.573073 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-feab12ce-b581-4c71-92fb-27f02bdd5407 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:36.636255 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-feab12ce-b581-4c71-92fb-27f02bdd5407 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:36.644034 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-feab12ce-b581-4c71-92fb-27f02bdd5407 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1223 microversion: 2.1 time: 0.085033 Oct 19 00:43:36.644607 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 301/579] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:36 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:37.044690 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-88870ba0-7261-457c-acfa-43b9d93c80a5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:37.045312 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-88870ba0-7261-457c-acfa-43b9d93c80a5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:37.052040 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-88870ba0-7261-457c-acfa-43b9d93c80a5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:37.052530 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-88870ba0-7261-457c-acfa-43b9d93c80a5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:37.053004 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-88870ba0-7261-457c-acfa-43b9d93c80a5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:37.053725 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-88870ba0-7261-457c-acfa-43b9d93c80a5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:37.054239 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-88870ba0-7261-457c-acfa-43b9d93c80a5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:37.054849 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-88870ba0-7261-457c-acfa-43b9d93c80a5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:37.197469 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-88870ba0-7261-457c-acfa-43b9d93c80a5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:37.206841 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-88870ba0-7261-457c-acfa-43b9d93c80a5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:37.208364 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-88870ba0-7261-457c-acfa-43b9d93c80a5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:37.209649 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-88870ba0-7261-457c-acfa-43b9d93c80a5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1807 microversion: 2.20 time: 0.168925 Oct 19 00:43:37.223878 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 279/580] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:37 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:37.666907 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-24e81613-18a3-4762-9fc7-a23a7589bcbf tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:37.667524 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-24e81613-18a3-4762-9fc7-a23a7589bcbf tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:37.674530 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-24e81613-18a3-4762-9fc7-a23a7589bcbf tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:37.674668 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-24e81613-18a3-4762-9fc7-a23a7589bcbf tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:37.675436 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-24e81613-18a3-4762-9fc7-a23a7589bcbf tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:37.676579 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-24e81613-18a3-4762-9fc7-a23a7589bcbf tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:37.677209 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-24e81613-18a3-4762-9fc7-a23a7589bcbf tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:37.677692 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-24e81613-18a3-4762-9fc7-a23a7589bcbf tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:37.739720 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-24e81613-18a3-4762-9fc7-a23a7589bcbf tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:37.748181 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-24e81613-18a3-4762-9fc7-a23a7589bcbf tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1223 microversion: 2.1 time: 0.085169 Oct 19 00:43:37.749070 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 302/581] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:37 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:38.236736 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-06dfb593-dd28-4c04-9e91-c0fe21042b24 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:38.237304 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-06dfb593-dd28-4c04-9e91-c0fe21042b24 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:38.244872 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-06dfb593-dd28-4c04-9e91-c0fe21042b24 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:38.245345 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-06dfb593-dd28-4c04-9e91-c0fe21042b24 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:38.245774 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-06dfb593-dd28-4c04-9e91-c0fe21042b24 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:38.246455 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-06dfb593-dd28-4c04-9e91-c0fe21042b24 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:38.246901 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-06dfb593-dd28-4c04-9e91-c0fe21042b24 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:38.247317 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-06dfb593-dd28-4c04-9e91-c0fe21042b24 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:38.393746 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-06dfb593-dd28-4c04-9e91-c0fe21042b24 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:38.402705 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-06dfb593-dd28-4c04-9e91-c0fe21042b24 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:38.404264 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-06dfb593-dd28-4c04-9e91-c0fe21042b24 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:38.405427 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-06dfb593-dd28-4c04-9e91-c0fe21042b24 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1807 microversion: 2.20 time: 0.172661 Oct 19 00:43:38.405994 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 280/582] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:38 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:38.772126 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-f94e09ed-1904-4938-80bf-a1987155d735 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:38.773971 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-f94e09ed-1904-4938-80bf-a1987155d735 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:38.784075 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f94e09ed-1904-4938-80bf-a1987155d735 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:38.785046 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f94e09ed-1904-4938-80bf-a1987155d735 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:38.785901 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f94e09ed-1904-4938-80bf-a1987155d735 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:38.787501 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f94e09ed-1904-4938-80bf-a1987155d735 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:38.788257 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f94e09ed-1904-4938-80bf-a1987155d735 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:38.789536 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f94e09ed-1904-4938-80bf-a1987155d735 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:38.853893 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-f94e09ed-1904-4938-80bf-a1987155d735 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:38.861611 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-f94e09ed-1904-4938-80bf-a1987155d735 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1223 microversion: 2.1 time: 0.093581 Oct 19 00:43:38.862167 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 303/583] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:38 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:39.430850 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-1220db8d-15d5-41af-b492-3a63369b8fa3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:39.431466 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-1220db8d-15d5-41af-b492-3a63369b8fa3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:39.438543 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1220db8d-15d5-41af-b492-3a63369b8fa3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:39.439089 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1220db8d-15d5-41af-b492-3a63369b8fa3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:39.439540 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1220db8d-15d5-41af-b492-3a63369b8fa3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:39.440318 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1220db8d-15d5-41af-b492-3a63369b8fa3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:39.440803 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1220db8d-15d5-41af-b492-3a63369b8fa3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:39.441307 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1220db8d-15d5-41af-b492-3a63369b8fa3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:39.579590 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-1220db8d-15d5-41af-b492-3a63369b8fa3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:39.588892 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-1220db8d-15d5-41af-b492-3a63369b8fa3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:39.599597 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-1220db8d-15d5-41af-b492-3a63369b8fa3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:39.599597 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-1220db8d-15d5-41af-b492-3a63369b8fa3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1807 microversion: 2.20 time: 0.167911 Oct 19 00:43:39.601627 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 281/584] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:39 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:39.885174 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-d32de82f-f00b-43a2-ad55-7315e0bfe126 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:39.885816 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-d32de82f-f00b-43a2-ad55-7315e0bfe126 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:39.892401 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d32de82f-f00b-43a2-ad55-7315e0bfe126 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:39.893003 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d32de82f-f00b-43a2-ad55-7315e0bfe126 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:39.893481 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d32de82f-f00b-43a2-ad55-7315e0bfe126 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:39.894278 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d32de82f-f00b-43a2-ad55-7315e0bfe126 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:39.894811 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d32de82f-f00b-43a2-ad55-7315e0bfe126 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:39.895286 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d32de82f-f00b-43a2-ad55-7315e0bfe126 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:39.961791 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-d32de82f-f00b-43a2-ad55-7315e0bfe126 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:39.969610 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-d32de82f-f00b-43a2-ad55-7315e0bfe126 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1223 microversion: 2.1 time: 0.089058 Oct 19 00:43:39.970553 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 304/585] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:39 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:40.622695 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-fa265c71-8ae3-4d4a-9bec-f121bc046843 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:40.624137 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-fa265c71-8ae3-4d4a-9bec-f121bc046843 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:40.632206 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fa265c71-8ae3-4d4a-9bec-f121bc046843 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:40.633957 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fa265c71-8ae3-4d4a-9bec-f121bc046843 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:40.634631 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fa265c71-8ae3-4d4a-9bec-f121bc046843 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:40.635555 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fa265c71-8ae3-4d4a-9bec-f121bc046843 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:40.636191 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fa265c71-8ae3-4d4a-9bec-f121bc046843 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:40.636623 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fa265c71-8ae3-4d4a-9bec-f121bc046843 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:40.769121 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-fa265c71-8ae3-4d4a-9bec-f121bc046843 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:40.785694 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-fa265c71-8ae3-4d4a-9bec-f121bc046843 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:40.787148 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-fa265c71-8ae3-4d4a-9bec-f121bc046843 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:40.788372 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-fa265c71-8ae3-4d4a-9bec-f121bc046843 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1807 microversion: 2.20 time: 0.169594 Oct 19 00:43:40.788982 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 282/586] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:40 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:40.995299 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-b4f3bd18-533b-4f63-8ea2-024c85706c28 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:40.995897 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-b4f3bd18-533b-4f63-8ea2-024c85706c28 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:41.003054 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b4f3bd18-533b-4f63-8ea2-024c85706c28 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:41.003568 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b4f3bd18-533b-4f63-8ea2-024c85706c28 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:41.004030 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b4f3bd18-533b-4f63-8ea2-024c85706c28 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:41.004730 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b4f3bd18-533b-4f63-8ea2-024c85706c28 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:41.005171 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b4f3bd18-533b-4f63-8ea2-024c85706c28 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:41.005586 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b4f3bd18-533b-4f63-8ea2-024c85706c28 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:41.076423 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-b4f3bd18-533b-4f63-8ea2-024c85706c28 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:41.084030 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-b4f3bd18-533b-4f63-8ea2-024c85706c28 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1223 microversion: 2.1 time: 0.093688 Oct 19 00:43:41.084591 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 305/587] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:40 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:41.814056 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-96f0b2c9-303b-4ab5-9728-30cb9610599d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:41.814657 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-96f0b2c9-303b-4ab5-9728-30cb9610599d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:41.821387 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-96f0b2c9-303b-4ab5-9728-30cb9610599d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:41.821867 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-96f0b2c9-303b-4ab5-9728-30cb9610599d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:41.822300 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-96f0b2c9-303b-4ab5-9728-30cb9610599d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:41.822992 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-96f0b2c9-303b-4ab5-9728-30cb9610599d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:41.823447 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-96f0b2c9-303b-4ab5-9728-30cb9610599d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:41.823901 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-96f0b2c9-303b-4ab5-9728-30cb9610599d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:41.973697 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-96f0b2c9-303b-4ab5-9728-30cb9610599d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:41.983937 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-96f0b2c9-303b-4ab5-9728-30cb9610599d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:41.986327 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-96f0b2c9-303b-4ab5-9728-30cb9610599d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:41.988365 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-96f0b2c9-303b-4ab5-9728-30cb9610599d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1807 microversion: 2.20 time: 0.177872 Oct 19 00:43:41.999739 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 283/588] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:41 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:42.107686 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-b9e2de89-1417-4cd1-962f-99de93164b7e tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:42.109042 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-b9e2de89-1417-4cd1-962f-99de93164b7e tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:42.116174 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b9e2de89-1417-4cd1-962f-99de93164b7e tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:42.117115 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b9e2de89-1417-4cd1-962f-99de93164b7e tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:42.117523 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b9e2de89-1417-4cd1-962f-99de93164b7e tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:42.118334 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b9e2de89-1417-4cd1-962f-99de93164b7e tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:42.118859 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b9e2de89-1417-4cd1-962f-99de93164b7e tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:42.119366 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b9e2de89-1417-4cd1-962f-99de93164b7e tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:42.190435 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-b9e2de89-1417-4cd1-962f-99de93164b7e tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:42.199513 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-b9e2de89-1417-4cd1-962f-99de93164b7e tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1223 microversion: 2.1 time: 0.096208 Oct 19 00:43:42.200189 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 306/589] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:42 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1223 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:43.015662 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-79347288-4a89-4c3a-924f-b29ce58e55f3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:43.016308 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-79347288-4a89-4c3a-924f-b29ce58e55f3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:43.023337 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-79347288-4a89-4c3a-924f-b29ce58e55f3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:43.023828 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-79347288-4a89-4c3a-924f-b29ce58e55f3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:43.024321 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-79347288-4a89-4c3a-924f-b29ce58e55f3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:43.025554 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-79347288-4a89-4c3a-924f-b29ce58e55f3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:43.026006 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-79347288-4a89-4c3a-924f-b29ce58e55f3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:43.026418 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-79347288-4a89-4c3a-924f-b29ce58e55f3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:43.054169 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:43.175748 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-79347288-4a89-4c3a-924f-b29ce58e55f3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:43.185922 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-79347288-4a89-4c3a-924f-b29ce58e55f3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:43.187365 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-79347288-4a89-4c3a-924f-b29ce58e55f3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:43.188555 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-79347288-4a89-4c3a-924f-b29ce58e55f3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1807 microversion: 2.20 time: 0.176809 Oct 19 00:43:43.189296 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 284/590] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:43 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:43.222865 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-d4485c69-4f2a-4e44-ace5-6d10af36d2d2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:43.223466 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-d4485c69-4f2a-4e44-ace5-6d10af36d2d2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:43.229978 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d4485c69-4f2a-4e44-ace5-6d10af36d2d2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:43.230459 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d4485c69-4f2a-4e44-ace5-6d10af36d2d2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:43.230891 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d4485c69-4f2a-4e44-ace5-6d10af36d2d2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:43.231578 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d4485c69-4f2a-4e44-ace5-6d10af36d2d2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:43.232067 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d4485c69-4f2a-4e44-ace5-6d10af36d2d2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:43.232522 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d4485c69-4f2a-4e44-ace5-6d10af36d2d2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:43.292901 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-d4485c69-4f2a-4e44-ace5-6d10af36d2d2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:43.301071 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-d4485c69-4f2a-4e44-ace5-6d10af36d2d2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1223 microversion: 2.1 time: 0.081985 Oct 19 00:43:43.301834 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 307/591] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:43 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:44.214565 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-4ac7ebfa-cbea-44ff-84b4-2a9874d14511 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:44.215154 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-4ac7ebfa-cbea-44ff-84b4-2a9874d14511 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:44.221619 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4ac7ebfa-cbea-44ff-84b4-2a9874d14511 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:44.222097 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4ac7ebfa-cbea-44ff-84b4-2a9874d14511 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:44.222527 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4ac7ebfa-cbea-44ff-84b4-2a9874d14511 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:44.223210 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4ac7ebfa-cbea-44ff-84b4-2a9874d14511 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:44.223657 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4ac7ebfa-cbea-44ff-84b4-2a9874d14511 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:44.224187 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4ac7ebfa-cbea-44ff-84b4-2a9874d14511 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:44.268892 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell0:SELECT=2 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:44.290541 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell0:SELECT=6 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:44.327528 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-145f62e0-49e8-49eb-88e6-66aa15caa30f tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:44.328167 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-145f62e0-49e8-49eb-88e6-66aa15caa30f tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:44.335577 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-145f62e0-49e8-49eb-88e6-66aa15caa30f tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:44.336165 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-145f62e0-49e8-49eb-88e6-66aa15caa30f tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:44.336603 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-145f62e0-49e8-49eb-88e6-66aa15caa30f tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:44.337248 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-145f62e0-49e8-49eb-88e6-66aa15caa30f tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:44.338971 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-145f62e0-49e8-49eb-88e6-66aa15caa30f tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:44.339269 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-145f62e0-49e8-49eb-88e6-66aa15caa30f tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:44.372188 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-4ac7ebfa-cbea-44ff-84b4-2a9874d14511 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:44.381111 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-4ac7ebfa-cbea-44ff-84b4-2a9874d14511 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:44.382699 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-4ac7ebfa-cbea-44ff-84b4-2a9874d14511 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:44.384028 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-4ac7ebfa-cbea-44ff-84b4-2a9874d14511 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1807 microversion: 2.20 time: 0.174054 Oct 19 00:43:44.384669 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 285/592] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:44 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:44.399071 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-145f62e0-49e8-49eb-88e6-66aa15caa30f tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:44.407367 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-145f62e0-49e8-49eb-88e6-66aa15caa30f tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1223 microversion: 2.1 time: 0.083601 Oct 19 00:43:44.407948 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 308/593] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:44 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:45.409370 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-664ee5e7-4eb8-48fd-b539-0c3bc3aa46c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:45.410003 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-664ee5e7-4eb8-48fd-b539-0c3bc3aa46c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:45.417534 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-664ee5e7-4eb8-48fd-b539-0c3bc3aa46c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:45.418010 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-664ee5e7-4eb8-48fd-b539-0c3bc3aa46c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:45.418456 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-664ee5e7-4eb8-48fd-b539-0c3bc3aa46c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:45.419119 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-664ee5e7-4eb8-48fd-b539-0c3bc3aa46c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:45.419565 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-664ee5e7-4eb8-48fd-b539-0c3bc3aa46c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:45.420087 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-664ee5e7-4eb8-48fd-b539-0c3bc3aa46c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:45.430338 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-dcc26e56-1d6d-4d0d-ac5d-b913d28703bd tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:45.430987 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-dcc26e56-1d6d-4d0d-ac5d-b913d28703bd tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:45.433104 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell0:SELECT=2 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:45.438870 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dcc26e56-1d6d-4d0d-ac5d-b913d28703bd tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:45.439354 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dcc26e56-1d6d-4d0d-ac5d-b913d28703bd tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:45.439813 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dcc26e56-1d6d-4d0d-ac5d-b913d28703bd tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:45.440580 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dcc26e56-1d6d-4d0d-ac5d-b913d28703bd tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:45.441043 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dcc26e56-1d6d-4d0d-ac5d-b913d28703bd tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:45.441474 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-dcc26e56-1d6d-4d0d-ac5d-b913d28703bd tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:45.504559 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-dcc26e56-1d6d-4d0d-ac5d-b913d28703bd tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:45.512504 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-dcc26e56-1d6d-4d0d-ac5d-b913d28703bd tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1223 microversion: 2.1 time: 0.085920 Oct 19 00:43:45.513075 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 309/594] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:45 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:43:45.551199 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-664ee5e7-4eb8-48fd-b539-0c3bc3aa46c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:45.559936 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-664ee5e7-4eb8-48fd-b539-0c3bc3aa46c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:45.561380 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-664ee5e7-4eb8-48fd-b539-0c3bc3aa46c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:45.562538 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-664ee5e7-4eb8-48fd-b539-0c3bc3aa46c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1807 microversion: 2.20 time: 0.157093 Oct 19 00:43:45.563094 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 286/595] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:45 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:46.535820 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-9676a261-d6e1-4277-82e1-d8548975f46f tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:46.536556 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-9676a261-d6e1-4277-82e1-d8548975f46f tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:46.543944 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9676a261-d6e1-4277-82e1-d8548975f46f tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:46.544422 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9676a261-d6e1-4277-82e1-d8548975f46f tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:46.544851 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9676a261-d6e1-4277-82e1-d8548975f46f tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:46.545539 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9676a261-d6e1-4277-82e1-d8548975f46f tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:46.545987 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9676a261-d6e1-4277-82e1-d8548975f46f tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:46.546402 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9676a261-d6e1-4277-82e1-d8548975f46f tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:46.586370 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-69adda1b-54b3-439d-916f-e7d8d797dd3a tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:46.586976 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-69adda1b-54b3-439d-916f-e7d8d797dd3a tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:46.593570 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-69adda1b-54b3-439d-916f-e7d8d797dd3a tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:46.594053 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-69adda1b-54b3-439d-916f-e7d8d797dd3a tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:46.594486 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-69adda1b-54b3-439d-916f-e7d8d797dd3a tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:46.595177 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-69adda1b-54b3-439d-916f-e7d8d797dd3a tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:46.595627 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-69adda1b-54b3-439d-916f-e7d8d797dd3a tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:46.596086 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-69adda1b-54b3-439d-916f-e7d8d797dd3a tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:46.609412 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-9676a261-d6e1-4277-82e1-d8548975f46f tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:46.617792 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-9676a261-d6e1-4277-82e1-d8548975f46f tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1223 microversion: 2.1 time: 0.085743 Oct 19 00:43:46.618560 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 310/596] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:46 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:46.724465 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-69adda1b-54b3-439d-916f-e7d8d797dd3a tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:46.733819 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-69adda1b-54b3-439d-916f-e7d8d797dd3a tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:46.735246 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-69adda1b-54b3-439d-916f-e7d8d797dd3a tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:46.736506 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-69adda1b-54b3-439d-916f-e7d8d797dd3a tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1807 microversion: 2.20 time: 0.153923 Oct 19 00:43:46.737057 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 287/597] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:46 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:43:47.641961 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-61a76379-b0ef-43c7-8528-2234ee4eb724 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:47.642577 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-61a76379-b0ef-43c7-8528-2234ee4eb724 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:47.648925 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-61a76379-b0ef-43c7-8528-2234ee4eb724 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:47.649407 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-61a76379-b0ef-43c7-8528-2234ee4eb724 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:47.649844 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-61a76379-b0ef-43c7-8528-2234ee4eb724 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:47.651157 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-61a76379-b0ef-43c7-8528-2234ee4eb724 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:47.651694 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-61a76379-b0ef-43c7-8528-2234ee4eb724 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:47.652173 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-61a76379-b0ef-43c7-8528-2234ee4eb724 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:47.711491 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-61a76379-b0ef-43c7-8528-2234ee4eb724 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:47.718962 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-61a76379-b0ef-43c7-8528-2234ee4eb724 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1223 microversion: 2.1 time: 0.080874 Oct 19 00:43:47.719518 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 311/598] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:47 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:47.763977 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-0d6b910a-7c74-41b9-91e5-6e8cd4265e03 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:47.764696 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-0d6b910a-7c74-41b9-91e5-6e8cd4265e03 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:47.771219 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0d6b910a-7c74-41b9-91e5-6e8cd4265e03 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:47.771705 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0d6b910a-7c74-41b9-91e5-6e8cd4265e03 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:47.772199 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0d6b910a-7c74-41b9-91e5-6e8cd4265e03 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:47.772906 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0d6b910a-7c74-41b9-91e5-6e8cd4265e03 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:47.773361 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0d6b910a-7c74-41b9-91e5-6e8cd4265e03 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:47.773789 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0d6b910a-7c74-41b9-91e5-6e8cd4265e03 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:47.905915 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-0d6b910a-7c74-41b9-91e5-6e8cd4265e03 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:47.914459 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-0d6b910a-7c74-41b9-91e5-6e8cd4265e03 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:47.915999 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-0d6b910a-7c74-41b9-91e5-6e8cd4265e03 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:47.917321 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-0d6b910a-7c74-41b9-91e5-6e8cd4265e03 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1807 microversion: 2.20 time: 0.158099 Oct 19 00:43:47.917886 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 288/599] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:47 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:48.741827 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-5a4cb150-2bca-4770-9015-c8692a595b3a tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:48.742433 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-5a4cb150-2bca-4770-9015-c8692a595b3a tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:48.748952 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5a4cb150-2bca-4770-9015-c8692a595b3a tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:48.749429 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5a4cb150-2bca-4770-9015-c8692a595b3a tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:48.749866 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5a4cb150-2bca-4770-9015-c8692a595b3a tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:48.750548 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5a4cb150-2bca-4770-9015-c8692a595b3a tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:48.750995 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5a4cb150-2bca-4770-9015-c8692a595b3a tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:48.751417 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5a4cb150-2bca-4770-9015-c8692a595b3a tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:48.811553 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-5a4cb150-2bca-4770-9015-c8692a595b3a tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:48.819684 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-5a4cb150-2bca-4770-9015-c8692a595b3a tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1223 microversion: 2.1 time: 0.081945 Oct 19 00:43:48.820271 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 312/600] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:48 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:48.943037 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-efeaed43-513f-45a5-8f5b-c477b9c5f2fa tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:48.943770 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-efeaed43-513f-45a5-8f5b-c477b9c5f2fa tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:48.950876 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-efeaed43-513f-45a5-8f5b-c477b9c5f2fa tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:48.951350 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-efeaed43-513f-45a5-8f5b-c477b9c5f2fa tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:48.951783 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-efeaed43-513f-45a5-8f5b-c477b9c5f2fa tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:48.952527 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-efeaed43-513f-45a5-8f5b-c477b9c5f2fa tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:48.952979 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-efeaed43-513f-45a5-8f5b-c477b9c5f2fa tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:48.953397 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-efeaed43-513f-45a5-8f5b-c477b9c5f2fa tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:49.081303 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-efeaed43-513f-45a5-8f5b-c477b9c5f2fa tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:49.090425 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-efeaed43-513f-45a5-8f5b-c477b9c5f2fa tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:49.091844 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-efeaed43-513f-45a5-8f5b-c477b9c5f2fa tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:49.093013 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-efeaed43-513f-45a5-8f5b-c477b9c5f2fa tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1807 microversion: 2.20 time: 0.154199 Oct 19 00:43:49.093564 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 289/601] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:48 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:49.843006 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-029055c3-1679-4bc5-a535-eea79bf707a7 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:49.843626 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-029055c3-1679-4bc5-a535-eea79bf707a7 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:49.850057 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-029055c3-1679-4bc5-a535-eea79bf707a7 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:49.850537 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-029055c3-1679-4bc5-a535-eea79bf707a7 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:49.850976 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-029055c3-1679-4bc5-a535-eea79bf707a7 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:49.851664 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-029055c3-1679-4bc5-a535-eea79bf707a7 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:49.852157 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-029055c3-1679-4bc5-a535-eea79bf707a7 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:49.852583 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-029055c3-1679-4bc5-a535-eea79bf707a7 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:49.915567 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-029055c3-1679-4bc5-a535-eea79bf707a7 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:49.923104 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-029055c3-1679-4bc5-a535-eea79bf707a7 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1223 microversion: 2.1 time: 0.083894 Oct 19 00:43:49.923665 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 313/602] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:49 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:50.118806 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-5701aac8-9153-44fc-b5e6-1d672e1e423d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:50.120020 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-5701aac8-9153-44fc-b5e6-1d672e1e423d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:50.126462 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5701aac8-9153-44fc-b5e6-1d672e1e423d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:50.126929 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5701aac8-9153-44fc-b5e6-1d672e1e423d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:50.127353 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5701aac8-9153-44fc-b5e6-1d672e1e423d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:50.128057 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5701aac8-9153-44fc-b5e6-1d672e1e423d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:50.128501 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5701aac8-9153-44fc-b5e6-1d672e1e423d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:50.128914 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5701aac8-9153-44fc-b5e6-1d672e1e423d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:50.260964 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-5701aac8-9153-44fc-b5e6-1d672e1e423d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:50.269564 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-5701aac8-9153-44fc-b5e6-1d672e1e423d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:50.270999 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-5701aac8-9153-44fc-b5e6-1d672e1e423d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:50.272195 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-5701aac8-9153-44fc-b5e6-1d672e1e423d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1807 microversion: 2.20 time: 0.157232 Oct 19 00:43:50.272754 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 290/603] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:50 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:50.946125 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-65bf2efe-1063-4927-aaa3-d4dd17e950a2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:50.946663 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-65bf2efe-1063-4927-aaa3-d4dd17e950a2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:50.953251 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-65bf2efe-1063-4927-aaa3-d4dd17e950a2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:50.953731 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-65bf2efe-1063-4927-aaa3-d4dd17e950a2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:50.954163 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-65bf2efe-1063-4927-aaa3-d4dd17e950a2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:50.954850 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-65bf2efe-1063-4927-aaa3-d4dd17e950a2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:50.955306 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-65bf2efe-1063-4927-aaa3-d4dd17e950a2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:50.955729 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-65bf2efe-1063-4927-aaa3-d4dd17e950a2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:50.970459 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell1:SELECT=100 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:51.016651 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-65bf2efe-1063-4927-aaa3-d4dd17e950a2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:51.024051 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-65bf2efe-1063-4927-aaa3-d4dd17e950a2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1223 microversion: 2.1 time: 0.081814 Oct 19 00:43:51.024610 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 314/604] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:50 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:51.296477 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-da203ecd-4057-470e-a440-91f2dcb20e31 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:51.297091 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-da203ecd-4057-470e-a440-91f2dcb20e31 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:51.303500 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-da203ecd-4057-470e-a440-91f2dcb20e31 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:51.304024 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-da203ecd-4057-470e-a440-91f2dcb20e31 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:51.304469 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-da203ecd-4057-470e-a440-91f2dcb20e31 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:51.305158 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-da203ecd-4057-470e-a440-91f2dcb20e31 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:51.305612 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-da203ecd-4057-470e-a440-91f2dcb20e31 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:51.306034 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-da203ecd-4057-470e-a440-91f2dcb20e31 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:51.436510 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-da203ecd-4057-470e-a440-91f2dcb20e31 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:51.445069 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-da203ecd-4057-470e-a440-91f2dcb20e31 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:51.446513 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-da203ecd-4057-470e-a440-91f2dcb20e31 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:51.448289 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-da203ecd-4057-470e-a440-91f2dcb20e31 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1807 microversion: 2.20 time: 0.155062 Oct 19 00:43:51.448852 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 291/605] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:51 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:52.047049 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-bd54cd12-6f0b-437f-85d5-d86d1b4b0865 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:52.047661 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-bd54cd12-6f0b-437f-85d5-d86d1b4b0865 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:52.053976 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-bd54cd12-6f0b-437f-85d5-d86d1b4b0865 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:52.054453 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-bd54cd12-6f0b-437f-85d5-d86d1b4b0865 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:52.054884 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-bd54cd12-6f0b-437f-85d5-d86d1b4b0865 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:52.055569 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-bd54cd12-6f0b-437f-85d5-d86d1b4b0865 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:52.056047 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-bd54cd12-6f0b-437f-85d5-d86d1b4b0865 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:52.056467 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-bd54cd12-6f0b-437f-85d5-d86d1b4b0865 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:52.115947 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-bd54cd12-6f0b-437f-85d5-d86d1b4b0865 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:52.124127 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-bd54cd12-6f0b-437f-85d5-d86d1b4b0865 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1223 microversion: 2.1 time: 0.080851 Oct 19 00:43:52.124691 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 315/606] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:52 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:52.473564 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-570aaf4e-ac8d-4d80-ac3a-41b85d434788 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:52.474098 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-570aaf4e-ac8d-4d80-ac3a-41b85d434788 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:52.481153 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-570aaf4e-ac8d-4d80-ac3a-41b85d434788 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:52.481624 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-570aaf4e-ac8d-4d80-ac3a-41b85d434788 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:52.482051 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-570aaf4e-ac8d-4d80-ac3a-41b85d434788 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:52.482724 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-570aaf4e-ac8d-4d80-ac3a-41b85d434788 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:52.483168 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-570aaf4e-ac8d-4d80-ac3a-41b85d434788 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:52.483606 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-570aaf4e-ac8d-4d80-ac3a-41b85d434788 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:52.613613 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-570aaf4e-ac8d-4d80-ac3a-41b85d434788 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:52.622417 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-570aaf4e-ac8d-4d80-ac3a-41b85d434788 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:52.623858 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-570aaf4e-ac8d-4d80-ac3a-41b85d434788 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:52.625022 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-570aaf4e-ac8d-4d80-ac3a-41b85d434788 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1807 microversion: 2.20 time: 0.155484 Oct 19 00:43:52.625572 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 292/607] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:52 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:53.146620 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-890f4240-bd0e-4fb2-89f0-ebc6cd288b9e tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:53.147211 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-890f4240-bd0e-4fb2-89f0-ebc6cd288b9e tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:53.153818 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-890f4240-bd0e-4fb2-89f0-ebc6cd288b9e tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:53.154299 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-890f4240-bd0e-4fb2-89f0-ebc6cd288b9e tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:53.154733 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-890f4240-bd0e-4fb2-89f0-ebc6cd288b9e tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:53.155434 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-890f4240-bd0e-4fb2-89f0-ebc6cd288b9e tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:53.155902 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-890f4240-bd0e-4fb2-89f0-ebc6cd288b9e tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:53.156326 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-890f4240-bd0e-4fb2-89f0-ebc6cd288b9e tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:53.248323 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-890f4240-bd0e-4fb2-89f0-ebc6cd288b9e tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:53.257530 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-890f4240-bd0e-4fb2-89f0-ebc6cd288b9e tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1215 microversion: 2.1 time: 0.114761 Oct 19 00:43:53.258097 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 316/608] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:53 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1215 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:53.651831 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-e4011f92-a219-462e-ba8d-527a9b3a8082 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:53.651831 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-e4011f92-a219-462e-ba8d-527a9b3a8082 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:53.658277 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e4011f92-a219-462e-ba8d-527a9b3a8082 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:53.658755 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e4011f92-a219-462e-ba8d-527a9b3a8082 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:53.659186 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e4011f92-a219-462e-ba8d-527a9b3a8082 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:53.659901 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e4011f92-a219-462e-ba8d-527a9b3a8082 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:53.660356 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e4011f92-a219-462e-ba8d-527a9b3a8082 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:53.660777 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e4011f92-a219-462e-ba8d-527a9b3a8082 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:53.788181 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-e4011f92-a219-462e-ba8d-527a9b3a8082 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:53.797828 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-e4011f92-a219-462e-ba8d-527a9b3a8082 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:53.799261 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-e4011f92-a219-462e-ba8d-527a9b3a8082 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:53.800463 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-e4011f92-a219-462e-ba8d-527a9b3a8082 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1807 microversion: 2.20 time: 0.153770 Oct 19 00:43:53.801023 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 293/609] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:53 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:54.280458 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-f4eb2c22-ae9e-4a15-b91c-a2567f3d61f2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:54.281099 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-f4eb2c22-ae9e-4a15-b91c-a2567f3d61f2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:54.287564 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f4eb2c22-ae9e-4a15-b91c-a2567f3d61f2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:54.288098 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f4eb2c22-ae9e-4a15-b91c-a2567f3d61f2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:54.288531 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f4eb2c22-ae9e-4a15-b91c-a2567f3d61f2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:54.289285 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f4eb2c22-ae9e-4a15-b91c-a2567f3d61f2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:54.298346 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f4eb2c22-ae9e-4a15-b91c-a2567f3d61f2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:54.298781 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f4eb2c22-ae9e-4a15-b91c-a2567f3d61f2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:54.368673 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-f4eb2c22-ae9e-4a15-b91c-a2567f3d61f2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:54.376359 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-f4eb2c22-ae9e-4a15-b91c-a2567f3d61f2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1271 microversion: 2.1 time: 0.099702 Oct 19 00:43:54.376917 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 317/610] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:54 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1271 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:54.826781 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-ca8de247-aa42-4557-b8bf-bb3aa45f27f6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:54.827478 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-ca8de247-aa42-4557-b8bf-bb3aa45f27f6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:54.834517 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ca8de247-aa42-4557-b8bf-bb3aa45f27f6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:54.835259 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ca8de247-aa42-4557-b8bf-bb3aa45f27f6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:54.835770 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ca8de247-aa42-4557-b8bf-bb3aa45f27f6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:54.836508 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ca8de247-aa42-4557-b8bf-bb3aa45f27f6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:54.836978 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ca8de247-aa42-4557-b8bf-bb3aa45f27f6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:54.837401 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ca8de247-aa42-4557-b8bf-bb3aa45f27f6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:54.987244 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-ca8de247-aa42-4557-b8bf-bb3aa45f27f6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:54.996866 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-ca8de247-aa42-4557-b8bf-bb3aa45f27f6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:54.998310 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-ca8de247-aa42-4557-b8bf-bb3aa45f27f6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:54.999467 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-ca8de247-aa42-4557-b8bf-bb3aa45f27f6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1807 microversion: 2.20 time: 0.177929 Oct 19 00:43:55.000060 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 294/611] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:54 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:55.400883 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-95a4620f-0ba8-4651-83c0-7ca1e1767958 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:55.401282 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-95a4620f-0ba8-4651-83c0-7ca1e1767958 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:55.407731 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-95a4620f-0ba8-4651-83c0-7ca1e1767958 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:55.408252 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-95a4620f-0ba8-4651-83c0-7ca1e1767958 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:55.408683 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-95a4620f-0ba8-4651-83c0-7ca1e1767958 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:55.409378 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-95a4620f-0ba8-4651-83c0-7ca1e1767958 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:55.409832 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-95a4620f-0ba8-4651-83c0-7ca1e1767958 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:55.410254 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-95a4620f-0ba8-4651-83c0-7ca1e1767958 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:55.657317 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-95a4620f-0ba8-4651-83c0-7ca1e1767958 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:55.664969 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-95a4620f-0ba8-4651-83c0-7ca1e1767958 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1319 microversion: 2.1 time: 0.269025 Oct 19 00:43:55.665530 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 318/612] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:55 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:55.788917 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-3ea551d7-fa17-44de-a953-9afcb7295538 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5c90d3e-3b9a-44e2-a1b5-5a7829829712"}} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:43:55.791491 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-3ea551d7-fa17-44de-a953-9afcb7295538 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:55.798177 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3ea551d7-fa17-44de-a953-9afcb7295538 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:55.798958 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3ea551d7-fa17-44de-a953-9afcb7295538 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:55.799399 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3ea551d7-fa17-44de-a953-9afcb7295538 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:55.800138 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3ea551d7-fa17-44de-a953-9afcb7295538 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:55.800596 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3ea551d7-fa17-44de-a953-9afcb7295538 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:55.801019 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3ea551d7-fa17-44de-a953-9afcb7295538 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:56.024918 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-6225cce6-182d-4f74-875b-bf9e988b9f08 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:56.025864 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-6225cce6-182d-4f74-875b-bf9e988b9f08 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:56.031881 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6225cce6-182d-4f74-875b-bf9e988b9f08 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:56.032621 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6225cce6-182d-4f74-875b-bf9e988b9f08 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:56.033223 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6225cce6-182d-4f74-875b-bf9e988b9f08 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:56.034083 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6225cce6-182d-4f74-875b-bf9e988b9f08 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:56.034681 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6225cce6-182d-4f74-875b-bf9e988b9f08 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:56.035273 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6225cce6-182d-4f74-875b-bf9e988b9f08 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:56.221082 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-3ea551d7-fa17-44de-a953-9afcb7295538 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "POST /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.436037 Oct 19 00:43:56.222118 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 295/613] 10.222.0.33 () {60 vars in 1323 bytes} [Wed Oct 19 00:43:55 2022] POST /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f/os-volume_attachments => generated 194 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:43:56.282182 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-0096b24d-01f0-4fe3-b0bf-5fd2da22373d req-ba9ee4d2-cd3c-4775-8ea6-74b10bfe1714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c74fb45-ef8a-4a88-8126-21c8266fddb2", "name": "network-vif-plugged", "status": "completed", "tag": "7926b647-0ec9-46fb-9fed-f33f2ff9fbcf"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:43:56.283494 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-6225cce6-182d-4f74-875b-bf9e988b9f08 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:56.293903 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-0096b24d-01f0-4fe3-b0bf-5fd2da22373d req-ba9ee4d2-cd3c-4775-8ea6-74b10bfe1714 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:56.294499 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-0096b24d-01f0-4fe3-b0bf-5fd2da22373d req-ba9ee4d2-cd3c-4775-8ea6-74b10bfe1714 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:56.294882 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-0096b24d-01f0-4fe3-b0bf-5fd2da22373d req-ba9ee4d2-cd3c-4775-8ea6-74b10bfe1714 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:56.296312 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-6225cce6-182d-4f74-875b-bf9e988b9f08 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:56.297746 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-6225cce6-182d-4f74-875b-bf9e988b9f08 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:56.301409 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-6225cce6-182d-4f74-875b-bf9e988b9f08 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1807 microversion: 2.20 time: 0.280710 Oct 19 00:43:56.317727 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 319/614] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:56 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1807 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:43:56.322815 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-0096b24d-01f0-4fe3-b0bf-5fd2da22373d req-ba9ee4d2-cd3c-4775-8ea6-74b10bfe1714 service nova] Creating event network-vif-plugged:7926b647-0ec9-46fb-9fed-f33f2ff9fbcf for instance 1c74fb45-ef8a-4a88-8126-21c8266fddb2 on hv-cinder-maste Oct 19 00:43:56.329728 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-0096b24d-01f0-4fe3-b0bf-5fd2da22373d req-ba9ee4d2-cd3c-4775-8ea6-74b10bfe1714 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055017 Oct 19 00:43:56.330799 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 296/615] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:43:56.473411 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-e9ad6670-7ef5-4744-a633-b98050990cd4 req-fc6f9f9b-9ed9-4dbd-9086-1878df6a8b75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "669ba27e-389e-4b04-959f-322c738a17df", "tag": "7357b679-ddd1-40f3-87a5-7d660205f2e1"}]} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:43:56.478724 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:56.486641 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-e9ad6670-7ef5-4744-a633-b98050990cd4 req-fc6f9f9b-9ed9-4dbd-9086-1878df6a8b75 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:56.487111 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-e9ad6670-7ef5-4744-a633-b98050990cd4 req-fc6f9f9b-9ed9-4dbd-9086-1878df6a8b75 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:56.487532 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-e9ad6670-7ef5-4744-a633-b98050990cd4 req-fc6f9f9b-9ed9-4dbd-9086-1878df6a8b75 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:56.504889 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.compute.server_external_events [req-e9ad6670-7ef5-4744-a633-b98050990cd4 req-fc6f9f9b-9ed9-4dbd-9086-1878df6a8b75 service nova] Creating event network-changed:7357b679-ddd1-40f3-87a5-7d660205f2e1 for instance 669ba27e-389e-4b04-959f-322c738a17df on hv-cinder-maste Oct 19 00:43:56.511181 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-e9ad6670-7ef5-4744-a633-b98050990cd4 req-fc6f9f9b-9ed9-4dbd-9086-1878df6a8b75 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040126 Oct 19 00:43:56.511913 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 320/616] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:43:56.689372 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-80738ca9-f769-464f-8204-c2c1d85c32a6 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:56.690067 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-80738ca9-f769-464f-8204-c2c1d85c32a6 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:56.696150 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-80738ca9-f769-464f-8204-c2c1d85c32a6 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:56.696630 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-80738ca9-f769-464f-8204-c2c1d85c32a6 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:56.697060 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-80738ca9-f769-464f-8204-c2c1d85c32a6 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:56.698422 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-80738ca9-f769-464f-8204-c2c1d85c32a6 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:56.699001 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-80738ca9-f769-464f-8204-c2c1d85c32a6 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:56.699425 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-80738ca9-f769-464f-8204-c2c1d85c32a6 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:56.831466 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-80738ca9-f769-464f-8204-c2c1d85c32a6 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:56.839121 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-80738ca9-f769-464f-8204-c2c1d85c32a6 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1319 microversion: 2.1 time: 0.154478 Oct 19 00:43:56.839695 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 297/617] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:56 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:57.328927 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-758160d5-7bc8-4761-90dd-2c1a2eb84284 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:57.329765 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-758160d5-7bc8-4761-90dd-2c1a2eb84284 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:57.336551 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-758160d5-7bc8-4761-90dd-2c1a2eb84284 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:57.337069 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-758160d5-7bc8-4761-90dd-2c1a2eb84284 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:57.337572 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-758160d5-7bc8-4761-90dd-2c1a2eb84284 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:57.338315 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-758160d5-7bc8-4761-90dd-2c1a2eb84284 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:57.338874 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-758160d5-7bc8-4761-90dd-2c1a2eb84284 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:57.339367 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-758160d5-7bc8-4761-90dd-2c1a2eb84284 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:57.471985 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-758160d5-7bc8-4761-90dd-2c1a2eb84284 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:57.480665 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-758160d5-7bc8-4761-90dd-2c1a2eb84284 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:57.482106 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-758160d5-7bc8-4761-90dd-2c1a2eb84284 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:57.483255 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-758160d5-7bc8-4761-90dd-2c1a2eb84284 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1807 microversion: 2.20 time: 0.159229 Oct 19 00:43:57.483839 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 321/618] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:57 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:57.862702 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-ac6ddbe7-ec7f-4908-8edb-65ce30f7a7e1 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:57.863666 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-ac6ddbe7-ec7f-4908-8edb-65ce30f7a7e1 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:57.866428 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:57.872109 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ac6ddbe7-ec7f-4908-8edb-65ce30f7a7e1 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:57.872584 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ac6ddbe7-ec7f-4908-8edb-65ce30f7a7e1 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:57.874212 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ac6ddbe7-ec7f-4908-8edb-65ce30f7a7e1 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:57.874910 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ac6ddbe7-ec7f-4908-8edb-65ce30f7a7e1 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:57.875362 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ac6ddbe7-ec7f-4908-8edb-65ce30f7a7e1 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:57.875782 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ac6ddbe7-ec7f-4908-8edb-65ce30f7a7e1 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:58.007573 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-ac6ddbe7-ec7f-4908-8edb-65ce30f7a7e1 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:58.015263 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-ac6ddbe7-ec7f-4908-8edb-65ce30f7a7e1 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1319 microversion: 2.1 time: 0.156462 Oct 19 00:43:58.015831 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 298/619] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:57 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:58.478771 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-6546358b-2bd0-4ae6-bcae-100924312ed2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:43:58.481012 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-6546358b-2bd0-4ae6-bcae-100924312ed2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:58.487739 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6546358b-2bd0-4ae6-bcae-100924312ed2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:58.488549 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6546358b-2bd0-4ae6-bcae-100924312ed2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:58.489058 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6546358b-2bd0-4ae6-bcae-100924312ed2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:58.489822 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6546358b-2bd0-4ae6-bcae-100924312ed2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:58.490344 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6546358b-2bd0-4ae6-bcae-100924312ed2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:58.490822 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6546358b-2bd0-4ae6-bcae-100924312ed2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:58.509652 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-2e533038-1c68-4528-ad22-a83401be539c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:58.510374 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-2e533038-1c68-4528-ad22-a83401be539c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:58.514362 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.objects.instance [None req-6546358b-2bd0-4ae6-bcae-100924312ed2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lazy-loading 'flavor' on Instance uuid 4b862704-38e5-4ea8-9fa2-741591535b6f {{(pid=125532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:43:58.517607 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2e533038-1c68-4528-ad22-a83401be539c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:58.518154 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2e533038-1c68-4528-ad22-a83401be539c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:58.518698 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2e533038-1c68-4528-ad22-a83401be539c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:58.519378 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2e533038-1c68-4528-ad22-a83401be539c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:58.519820 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2e533038-1c68-4528-ad22-a83401be539c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:58.520260 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2e533038-1c68-4528-ad22-a83401be539c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:58.644837 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-6546358b-2bd0-4ae6-bcae-100924312ed2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "POST /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f/action" status: 200 len: 32 microversion: 2.1 time: 0.170403 Oct 19 00:43:58.645639 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 322/620] 10.222.0.33 () {60 vars in 1278 bytes} [Wed Oct 19 00:43:58 2022] POST /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f/action => generated 32 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:43:58.656527 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-8f81c2a7-751a-48ef-acd8-c1f87b22648c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:58.657256 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-8f81c2a7-751a-48ef-acd8-c1f87b22648c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:58.662260 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-2e533038-1c68-4528-ad22-a83401be539c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:58.664160 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8f81c2a7-751a-48ef-acd8-c1f87b22648c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:58.664656 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8f81c2a7-751a-48ef-acd8-c1f87b22648c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:58.665094 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8f81c2a7-751a-48ef-acd8-c1f87b22648c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:58.665821 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8f81c2a7-751a-48ef-acd8-c1f87b22648c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:58.666278 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8f81c2a7-751a-48ef-acd8-c1f87b22648c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:58.666700 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8f81c2a7-751a-48ef-acd8-c1f87b22648c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:58.671629 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-2e533038-1c68-4528-ad22-a83401be539c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:58.673113 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-2e533038-1c68-4528-ad22-a83401be539c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:58.674358 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-2e533038-1c68-4528-ad22-a83401be539c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1807 microversion: 2.20 time: 0.168648 Oct 19 00:43:58.674965 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 299/621] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:58 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:43:58.803195 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-8f81c2a7-751a-48ef-acd8-c1f87b22648c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:58.812000 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-8f81c2a7-751a-48ef-acd8-c1f87b22648c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1735 microversion: 2.1 time: 0.160704 Oct 19 00:43:58.812570 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 323/622] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:58 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:43:59.037795 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-229d08f1-97ea-4e1a-b02d-8fbe6fef493a tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:59.038410 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-229d08f1-97ea-4e1a-b02d-8fbe6fef493a tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:59.044296 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-229d08f1-97ea-4e1a-b02d-8fbe6fef493a tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:59.044807 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-229d08f1-97ea-4e1a-b02d-8fbe6fef493a tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:59.045303 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-229d08f1-97ea-4e1a-b02d-8fbe6fef493a tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:59.045990 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-229d08f1-97ea-4e1a-b02d-8fbe6fef493a tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:59.046443 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-229d08f1-97ea-4e1a-b02d-8fbe6fef493a tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:59.046973 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-229d08f1-97ea-4e1a-b02d-8fbe6fef493a tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:59.061693 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:59.174582 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-229d08f1-97ea-4e1a-b02d-8fbe6fef493a tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:59.182167 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-229d08f1-97ea-4e1a-b02d-8fbe6fef493a tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1319 microversion: 2.1 time: 0.148227 Oct 19 00:43:59.182821 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 300/623] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:59 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:59.699685 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-0f36de34-febe-4f67-b7fb-38053f26a6d6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:59.700315 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-0f36de34-febe-4f67-b7fb-38053f26a6d6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:59.707158 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0f36de34-febe-4f67-b7fb-38053f26a6d6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:59.707639 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0f36de34-febe-4f67-b7fb-38053f26a6d6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:59.708102 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0f36de34-febe-4f67-b7fb-38053f26a6d6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:59.708796 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0f36de34-febe-4f67-b7fb-38053f26a6d6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:59.709245 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0f36de34-febe-4f67-b7fb-38053f26a6d6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:59.709666 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0f36de34-febe-4f67-b7fb-38053f26a6d6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:59.835862 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-a6bb8e18-a711-4c0f-a582-1e762dc113e9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:59.836403 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-a6bb8e18-a711-4c0f-a582-1e762dc113e9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:59.843454 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a6bb8e18-a711-4c0f-a582-1e762dc113e9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:59.843977 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a6bb8e18-a711-4c0f-a582-1e762dc113e9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:59.844415 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a6bb8e18-a711-4c0f-a582-1e762dc113e9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:59.845118 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a6bb8e18-a711-4c0f-a582-1e762dc113e9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:59.845572 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a6bb8e18-a711-4c0f-a582-1e762dc113e9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:59.846004 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a6bb8e18-a711-4c0f-a582-1e762dc113e9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:59.984969 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-a6bb8e18-a711-4c0f-a582-1e762dc113e9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:59.993520 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-a6bb8e18-a711-4c0f-a582-1e762dc113e9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1735 microversion: 2.1 time: 0.161612 Oct 19 00:43:59.994239 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 301/624] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:59 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:44:00.014068 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-0f36de34-febe-4f67-b7fb-38053f26a6d6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:00.022727 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-0f36de34-febe-4f67-b7fb-38053f26a6d6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:00.024187 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-0f36de34-febe-4f67-b7fb-38053f26a6d6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:00.025348 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-0f36de34-febe-4f67-b7fb-38053f26a6d6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1807 microversion: 2.20 time: 0.329564 Oct 19 00:44:00.025931 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 324/625] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:43:59 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1807 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:44:00.206580 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-393e4936-eec9-4654-b09a-68e9b953d028 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:00.207188 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-393e4936-eec9-4654-b09a-68e9b953d028 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:00.212967 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-393e4936-eec9-4654-b09a-68e9b953d028 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:00.213440 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-393e4936-eec9-4654-b09a-68e9b953d028 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:00.213870 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-393e4936-eec9-4654-b09a-68e9b953d028 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:00.214550 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-393e4936-eec9-4654-b09a-68e9b953d028 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:00.214995 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-393e4936-eec9-4654-b09a-68e9b953d028 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:00.215413 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-393e4936-eec9-4654-b09a-68e9b953d028 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:00.344749 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-393e4936-eec9-4654-b09a-68e9b953d028 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:00.352365 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-393e4936-eec9-4654-b09a-68e9b953d028 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1319 microversion: 2.1 time: 0.150081 Oct 19 00:44:00.352927 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 302/626] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:00 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:01.016231 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-95d75d04-2f16-4677-8914-84e3aff1c943 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:01.016841 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-95d75d04-2f16-4677-8914-84e3aff1c943 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:01.024384 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-95d75d04-2f16-4677-8914-84e3aff1c943 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:01.024866 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-95d75d04-2f16-4677-8914-84e3aff1c943 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:01.025294 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-95d75d04-2f16-4677-8914-84e3aff1c943 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:01.025982 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-95d75d04-2f16-4677-8914-84e3aff1c943 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:01.026425 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-95d75d04-2f16-4677-8914-84e3aff1c943 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:01.026851 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-95d75d04-2f16-4677-8914-84e3aff1c943 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:01.051764 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-a0008ae9-18a4-4c50-b67e-be7ea4d7ac8e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:01.052340 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-a0008ae9-18a4-4c50-b67e-be7ea4d7ac8e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:01.059105 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a0008ae9-18a4-4c50-b67e-be7ea4d7ac8e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:01.059582 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a0008ae9-18a4-4c50-b67e-be7ea4d7ac8e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:01.060050 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a0008ae9-18a4-4c50-b67e-be7ea4d7ac8e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:01.061754 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a0008ae9-18a4-4c50-b67e-be7ea4d7ac8e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:01.062165 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a0008ae9-18a4-4c50-b67e-be7ea4d7ac8e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:01.062613 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a0008ae9-18a4-4c50-b67e-be7ea4d7ac8e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:01.165676 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-95d75d04-2f16-4677-8914-84e3aff1c943 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:01.175186 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-95d75d04-2f16-4677-8914-84e3aff1c943 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1735 microversion: 2.1 time: 0.162832 Oct 19 00:44:01.175990 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 325/627] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:01 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:01.196044 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-a0008ae9-18a4-4c50-b67e-be7ea4d7ac8e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:01.204594 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-a0008ae9-18a4-4c50-b67e-be7ea4d7ac8e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:01.206034 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-a0008ae9-18a4-4c50-b67e-be7ea4d7ac8e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:01.207189 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-a0008ae9-18a4-4c50-b67e-be7ea4d7ac8e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1807 microversion: 2.20 time: 0.159549 Oct 19 00:44:01.207755 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 303/628] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:44:01 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:44:01.375381 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-be57c886-c67b-440d-9c00-3cb9992b606b tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:01.375924 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-be57c886-c67b-440d-9c00-3cb9992b606b tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:01.381809 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-be57c886-c67b-440d-9c00-3cb9992b606b tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:01.382282 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-be57c886-c67b-440d-9c00-3cb9992b606b tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:01.382711 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-be57c886-c67b-440d-9c00-3cb9992b606b tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:01.383385 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-be57c886-c67b-440d-9c00-3cb9992b606b tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:01.383835 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-be57c886-c67b-440d-9c00-3cb9992b606b tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:01.384278 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-be57c886-c67b-440d-9c00-3cb9992b606b tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:01.508727 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-be57c886-c67b-440d-9c00-3cb9992b606b tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:01.517404 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-be57c886-c67b-440d-9c00-3cb9992b606b tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1319 microversion: 2.1 time: 0.146859 Oct 19 00:44:01.517965 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 326/629] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:01 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:02.198507 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-1133aba5-c425-46ce-8fb1-0bcaaaae60c3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:02.199149 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-1133aba5-c425-46ce-8fb1-0bcaaaae60c3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:02.206828 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1133aba5-c425-46ce-8fb1-0bcaaaae60c3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:02.207310 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1133aba5-c425-46ce-8fb1-0bcaaaae60c3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:02.207878 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1133aba5-c425-46ce-8fb1-0bcaaaae60c3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:02.208548 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1133aba5-c425-46ce-8fb1-0bcaaaae60c3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:02.209063 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1133aba5-c425-46ce-8fb1-0bcaaaae60c3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:02.209520 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1133aba5-c425-46ce-8fb1-0bcaaaae60c3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:02.232625 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-01f683d5-f4ec-4b74-81ed-117784d4c938 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:02.233272 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-01f683d5-f4ec-4b74-81ed-117784d4c938 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:02.239835 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-01f683d5-f4ec-4b74-81ed-117784d4c938 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:02.240427 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-01f683d5-f4ec-4b74-81ed-117784d4c938 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:02.240859 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-01f683d5-f4ec-4b74-81ed-117784d4c938 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:02.241547 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-01f683d5-f4ec-4b74-81ed-117784d4c938 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:02.242000 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-01f683d5-f4ec-4b74-81ed-117784d4c938 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:02.242418 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-01f683d5-f4ec-4b74-81ed-117784d4c938 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:02.346500 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-1133aba5-c425-46ce-8fb1-0bcaaaae60c3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:02.354820 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-1133aba5-c425-46ce-8fb1-0bcaaaae60c3 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1735 microversion: 2.1 time: 0.160197 Oct 19 00:44:02.355375 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 304/630] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:02 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:44:02.372274 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-01f683d5-f4ec-4b74-81ed-117784d4c938 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:02.381352 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-01f683d5-f4ec-4b74-81ed-117784d4c938 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:02.382761 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-01f683d5-f4ec-4b74-81ed-117784d4c938 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:02.383920 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-01f683d5-f4ec-4b74-81ed-117784d4c938 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1807 microversion: 2.20 time: 0.155326 Oct 19 00:44:02.384482 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 327/631] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:44:02 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:44:02.540644 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-12c6eef3-5b92-443e-a4d2-3ca7a6d39934 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:02.541257 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-12c6eef3-5b92-443e-a4d2-3ca7a6d39934 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:02.547692 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-12c6eef3-5b92-443e-a4d2-3ca7a6d39934 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:02.548377 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-12c6eef3-5b92-443e-a4d2-3ca7a6d39934 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:02.548823 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-12c6eef3-5b92-443e-a4d2-3ca7a6d39934 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:02.549515 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-12c6eef3-5b92-443e-a4d2-3ca7a6d39934 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:02.549979 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-12c6eef3-5b92-443e-a4d2-3ca7a6d39934 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:02.550401 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-12c6eef3-5b92-443e-a4d2-3ca7a6d39934 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:02.679749 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-12c6eef3-5b92-443e-a4d2-3ca7a6d39934 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:02.687440 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-12c6eef3-5b92-443e-a4d2-3ca7a6d39934 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1319 microversion: 2.1 time: 0.150784 Oct 19 00:44:02.688049 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 305/632] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:02 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:44:03.378006 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-f5f7e236-5eb7-4775-8200-418ed9c22605 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:03.378637 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-f5f7e236-5eb7-4775-8200-418ed9c22605 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:03.385266 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f5f7e236-5eb7-4775-8200-418ed9c22605 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:03.385749 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f5f7e236-5eb7-4775-8200-418ed9c22605 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:03.386184 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f5f7e236-5eb7-4775-8200-418ed9c22605 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:03.386880 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f5f7e236-5eb7-4775-8200-418ed9c22605 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:03.387337 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f5f7e236-5eb7-4775-8200-418ed9c22605 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:03.387764 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f5f7e236-5eb7-4775-8200-418ed9c22605 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:03.409964 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-2f5d3157-70a2-4098-83ef-6fe3a4e1d213 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:03.410569 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-2f5d3157-70a2-4098-83ef-6fe3a4e1d213 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:03.418449 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2f5d3157-70a2-4098-83ef-6fe3a4e1d213 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:03.419385 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2f5d3157-70a2-4098-83ef-6fe3a4e1d213 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:03.420131 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2f5d3157-70a2-4098-83ef-6fe3a4e1d213 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:03.421240 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2f5d3157-70a2-4098-83ef-6fe3a4e1d213 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:03.421910 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2f5d3157-70a2-4098-83ef-6fe3a4e1d213 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:03.423874 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2f5d3157-70a2-4098-83ef-6fe3a4e1d213 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:03.578282 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-2f5d3157-70a2-4098-83ef-6fe3a4e1d213 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:03.587495 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-2f5d3157-70a2-4098-83ef-6fe3a4e1d213 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:03.589044 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-2f5d3157-70a2-4098-83ef-6fe3a4e1d213 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:03.590213 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-2f5d3157-70a2-4098-83ef-6fe3a4e1d213 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1807 microversion: 2.20 time: 0.184176 Oct 19 00:44:03.596308 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 306/633] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:44:03 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1807 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:44:03.614103 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-f5f7e236-5eb7-4775-8200-418ed9c22605 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:03.622474 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-f5f7e236-5eb7-4775-8200-418ed9c22605 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1735 microversion: 2.1 time: 0.248393 Oct 19 00:44:03.626374 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 328/634] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:03 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1735 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:03.709205 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-a2b450c8-6da2-4497-b755-560441fcf935 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:03.709815 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-a2b450c8-6da2-4497-b755-560441fcf935 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:03.715822 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a2b450c8-6da2-4497-b755-560441fcf935 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:03.716341 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a2b450c8-6da2-4497-b755-560441fcf935 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:03.717399 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a2b450c8-6da2-4497-b755-560441fcf935 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:03.718090 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a2b450c8-6da2-4497-b755-560441fcf935 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:03.718552 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a2b450c8-6da2-4497-b755-560441fcf935 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:03.718986 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a2b450c8-6da2-4497-b755-560441fcf935 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:03.848717 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-a2b450c8-6da2-4497-b755-560441fcf935 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:03.856349 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-a2b450c8-6da2-4497-b755-560441fcf935 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1319 microversion: 2.1 time: 0.150922 Oct 19 00:44:03.857131 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 307/635] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:03 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:04.617271 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-202deb46-2742-4c50-85a3-4f91b354a1cd tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:04.617930 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-202deb46-2742-4c50-85a3-4f91b354a1cd tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:04.624847 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-202deb46-2742-4c50-85a3-4f91b354a1cd tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:04.625324 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-202deb46-2742-4c50-85a3-4f91b354a1cd tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:04.625755 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-202deb46-2742-4c50-85a3-4f91b354a1cd tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:04.626445 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-202deb46-2742-4c50-85a3-4f91b354a1cd tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:04.626902 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-202deb46-2742-4c50-85a3-4f91b354a1cd tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:04.627323 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-202deb46-2742-4c50-85a3-4f91b354a1cd tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:04.646149 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-5b517df5-3111-4c66-a887-94866b1a369a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:04.646870 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-5b517df5-3111-4c66-a887-94866b1a369a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:04.653251 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5b517df5-3111-4c66-a887-94866b1a369a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:04.653733 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5b517df5-3111-4c66-a887-94866b1a369a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:04.654254 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5b517df5-3111-4c66-a887-94866b1a369a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:04.654855 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5b517df5-3111-4c66-a887-94866b1a369a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:04.655304 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5b517df5-3111-4c66-a887-94866b1a369a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:04.655724 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5b517df5-3111-4c66-a887-94866b1a369a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:04.758669 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-202deb46-2742-4c50-85a3-4f91b354a1cd tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:04.761079 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:04.769913 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-202deb46-2742-4c50-85a3-4f91b354a1cd tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:04.771444 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-202deb46-2742-4c50-85a3-4f91b354a1cd tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:04.772762 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-202deb46-2742-4c50-85a3-4f91b354a1cd tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1794 microversion: 2.20 time: 0.159758 Oct 19 00:44:04.773442 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 329/636] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:44:04 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1794 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:44:04.791642 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-5b517df5-3111-4c66-a887-94866b1a369a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:04.800900 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-5b517df5-3111-4c66-a887-94866b1a369a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1735 microversion: 2.1 time: 0.158497 Oct 19 00:44:04.801478 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 308/637] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:04 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:04.879170 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-fa8dddac-4859-4ccf-8a8e-228b80c58424 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:04.879693 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-fa8dddac-4859-4ccf-8a8e-228b80c58424 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:04.886986 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-fa8dddac-4859-4ccf-8a8e-228b80c58424 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:04.887539 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-fa8dddac-4859-4ccf-8a8e-228b80c58424 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:04.888064 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-fa8dddac-4859-4ccf-8a8e-228b80c58424 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:04.889146 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-fa8dddac-4859-4ccf-8a8e-228b80c58424 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:04.889611 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-fa8dddac-4859-4ccf-8a8e-228b80c58424 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:04.890108 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-fa8dddac-4859-4ccf-8a8e-228b80c58424 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:05.025526 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-fa8dddac-4859-4ccf-8a8e-228b80c58424 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:05.033721 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-fa8dddac-4859-4ccf-8a8e-228b80c58424 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1319 microversion: 2.1 time: 0.158862 Oct 19 00:44:05.034290 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 330/638] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:04 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:05.824816 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-579b9e9f-7d8b-4b5d-b78a-71a53bdded98 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:05.825452 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-579b9e9f-7d8b-4b5d-b78a-71a53bdded98 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:05.832582 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-579b9e9f-7d8b-4b5d-b78a-71a53bdded98 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:05.833063 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-579b9e9f-7d8b-4b5d-b78a-71a53bdded98 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:05.833497 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-579b9e9f-7d8b-4b5d-b78a-71a53bdded98 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:05.834182 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-579b9e9f-7d8b-4b5d-b78a-71a53bdded98 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:05.834632 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-579b9e9f-7d8b-4b5d-b78a-71a53bdded98 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:05.835055 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-579b9e9f-7d8b-4b5d-b78a-71a53bdded98 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:05.964594 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-579b9e9f-7d8b-4b5d-b78a-71a53bdded98 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:05.972948 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-579b9e9f-7d8b-4b5d-b78a-71a53bdded98 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1735 microversion: 2.1 time: 0.152000 Oct 19 00:44:05.973514 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 309/639] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:05 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:06.058479 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-6ea7b69c-e881-4366-a356-3e728960e4e2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:06.059223 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-6ea7b69c-e881-4366-a356-3e728960e4e2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:06.066286 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6ea7b69c-e881-4366-a356-3e728960e4e2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:06.066796 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6ea7b69c-e881-4366-a356-3e728960e4e2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:06.067227 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6ea7b69c-e881-4366-a356-3e728960e4e2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:06.067941 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6ea7b69c-e881-4366-a356-3e728960e4e2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:06.068481 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6ea7b69c-e881-4366-a356-3e728960e4e2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:06.068886 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6ea7b69c-e881-4366-a356-3e728960e4e2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:06.199878 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-6ea7b69c-e881-4366-a356-3e728960e4e2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:06.207586 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-6ea7b69c-e881-4366-a356-3e728960e4e2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1319 microversion: 2.1 time: 0.152918 Oct 19 00:44:06.208179 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 331/640] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:06 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:06.495361 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-7d907f37-da18-45bc-923f-2f706827728e req-92a1e0e0-560b-4e8b-bccf-0e9ce53fa60d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "669ba27e-389e-4b04-959f-322c738a17df", "name": "network-vif-plugged", "status": "completed", "tag": "7357b679-ddd1-40f3-87a5-7d660205f2e1"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:06.505979 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-7d907f37-da18-45bc-923f-2f706827728e req-92a1e0e0-560b-4e8b-bccf-0e9ce53fa60d service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:06.506458 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-7d907f37-da18-45bc-923f-2f706827728e req-92a1e0e0-560b-4e8b-bccf-0e9ce53fa60d service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:06.507071 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-7d907f37-da18-45bc-923f-2f706827728e req-92a1e0e0-560b-4e8b-bccf-0e9ce53fa60d service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:06.518651 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-7d907f37-da18-45bc-923f-2f706827728e req-92a1e0e0-560b-4e8b-bccf-0e9ce53fa60d service nova] Creating event network-vif-plugged:7357b679-ddd1-40f3-87a5-7d660205f2e1 for instance 669ba27e-389e-4b04-959f-322c738a17df on hv-cinder-maste Oct 19 00:44:06.523574 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-7d907f37-da18-45bc-923f-2f706827728e req-92a1e0e0-560b-4e8b-bccf-0e9ce53fa60d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032061 Oct 19 00:44:06.524258 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 310/641] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:06.996429 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-6cf9eaca-92c3-4392-a45c-ff8d8a89f8ac tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:06.997044 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-6cf9eaca-92c3-4392-a45c-ff8d8a89f8ac tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:07.003088 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6cf9eaca-92c3-4392-a45c-ff8d8a89f8ac tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:07.003571 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6cf9eaca-92c3-4392-a45c-ff8d8a89f8ac tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:07.004041 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6cf9eaca-92c3-4392-a45c-ff8d8a89f8ac tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:07.004734 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6cf9eaca-92c3-4392-a45c-ff8d8a89f8ac tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:07.005183 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6cf9eaca-92c3-4392-a45c-ff8d8a89f8ac tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:07.005601 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6cf9eaca-92c3-4392-a45c-ff8d8a89f8ac tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:07.135374 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-6cf9eaca-92c3-4392-a45c-ff8d8a89f8ac tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:07.144126 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-6cf9eaca-92c3-4392-a45c-ff8d8a89f8ac tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1735 microversion: 2.1 time: 0.151530 Oct 19 00:44:07.144693 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 332/642] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:06 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:07.231360 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-ea8d50e7-1ea7-45a3-b64b-e004e6e43f94 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:07.232155 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-ea8d50e7-1ea7-45a3-b64b-e004e6e43f94 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:07.239029 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ea8d50e7-1ea7-45a3-b64b-e004e6e43f94 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:07.239500 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ea8d50e7-1ea7-45a3-b64b-e004e6e43f94 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:07.239959 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ea8d50e7-1ea7-45a3-b64b-e004e6e43f94 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:07.240637 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ea8d50e7-1ea7-45a3-b64b-e004e6e43f94 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:07.241084 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ea8d50e7-1ea7-45a3-b64b-e004e6e43f94 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:07.241499 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ea8d50e7-1ea7-45a3-b64b-e004e6e43f94 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:07.368234 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-ea8d50e7-1ea7-45a3-b64b-e004e6e43f94 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:07.376764 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-ea8d50e7-1ea7-45a3-b64b-e004e6e43f94 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1319 microversion: 2.1 time: 0.150004 Oct 19 00:44:07.377325 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 311/643] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:07 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:08.167587 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-a8a01e60-8241-405c-8b97-a46de36a5d39 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:08.168324 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-a8a01e60-8241-405c-8b97-a46de36a5d39 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:08.175437 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a8a01e60-8241-405c-8b97-a46de36a5d39 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:08.175949 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a8a01e60-8241-405c-8b97-a46de36a5d39 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:08.176386 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a8a01e60-8241-405c-8b97-a46de36a5d39 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:08.177277 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a8a01e60-8241-405c-8b97-a46de36a5d39 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:08.177786 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a8a01e60-8241-405c-8b97-a46de36a5d39 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:08.178212 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a8a01e60-8241-405c-8b97-a46de36a5d39 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:08.312683 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-a8a01e60-8241-405c-8b97-a46de36a5d39 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:08.321559 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-a8a01e60-8241-405c-8b97-a46de36a5d39 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1735 microversion: 2.1 time: 0.157900 Oct 19 00:44:08.322176 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 333/644] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:08 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:08.401798 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-3e717fc5-f22e-4b31-99fb-94c6a5017675 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:08.402998 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-3e717fc5-f22e-4b31-99fb-94c6a5017675 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:08.411514 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3e717fc5-f22e-4b31-99fb-94c6a5017675 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:08.412150 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3e717fc5-f22e-4b31-99fb-94c6a5017675 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:08.412751 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3e717fc5-f22e-4b31-99fb-94c6a5017675 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:08.413905 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3e717fc5-f22e-4b31-99fb-94c6a5017675 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:08.414633 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3e717fc5-f22e-4b31-99fb-94c6a5017675 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:08.415285 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3e717fc5-f22e-4b31-99fb-94c6a5017675 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:08.557150 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-3e717fc5-f22e-4b31-99fb-94c6a5017675 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:08.565826 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-3e717fc5-f22e-4b31-99fb-94c6a5017675 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1319 microversion: 2.1 time: 0.168470 Oct 19 00:44:08.566775 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 312/645] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:08 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:09.347553 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-0e6ad8c8-904c-40fe-9446-472e2ceebaf6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:09.348195 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-0e6ad8c8-904c-40fe-9446-472e2ceebaf6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:09.354860 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0e6ad8c8-904c-40fe-9446-472e2ceebaf6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:09.355372 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0e6ad8c8-904c-40fe-9446-472e2ceebaf6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:09.355812 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0e6ad8c8-904c-40fe-9446-472e2ceebaf6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:09.356554 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0e6ad8c8-904c-40fe-9446-472e2ceebaf6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:09.357008 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0e6ad8c8-904c-40fe-9446-472e2ceebaf6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:09.357433 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0e6ad8c8-904c-40fe-9446-472e2ceebaf6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:09.485770 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-0e6ad8c8-904c-40fe-9446-472e2ceebaf6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:09.494089 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-0e6ad8c8-904c-40fe-9446-472e2ceebaf6 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1735 microversion: 2.1 time: 0.150371 Oct 19 00:44:09.494650 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 334/646] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:09 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:09.589572 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-2b241262-4c0e-4d64-869a-8dc6144419e5 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:09.590179 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-2b241262-4c0e-4d64-869a-8dc6144419e5 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:09.597110 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2b241262-4c0e-4d64-869a-8dc6144419e5 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:09.597643 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2b241262-4c0e-4d64-869a-8dc6144419e5 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:09.598051 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2b241262-4c0e-4d64-869a-8dc6144419e5 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:09.598739 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2b241262-4c0e-4d64-869a-8dc6144419e5 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:09.599189 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2b241262-4c0e-4d64-869a-8dc6144419e5 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:09.599609 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2b241262-4c0e-4d64-869a-8dc6144419e5 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:09.730896 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-2b241262-4c0e-4d64-869a-8dc6144419e5 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:09.738951 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-2b241262-4c0e-4d64-869a-8dc6144419e5 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1508 microversion: 2.1 time: 0.152903 Oct 19 00:44:09.739515 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 313/647] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:09 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:09.761014 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-a88b9146-0b73-458b-8775-e1456fb490d1 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c5f2e01-9162-4cd7-9ed3-f4a558bce611", "device": "/dev/sdb"}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:09.763444 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-a88b9146-0b73-458b-8775-e1456fb490d1 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:09.769928 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a88b9146-0b73-458b-8775-e1456fb490d1 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:09.770401 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a88b9146-0b73-458b-8775-e1456fb490d1 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:09.770828 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a88b9146-0b73-458b-8775-e1456fb490d1 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:09.771507 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a88b9146-0b73-458b-8775-e1456fb490d1 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:09.771986 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a88b9146-0b73-458b-8775-e1456fb490d1 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:09.772406 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a88b9146-0b73-458b-8775-e1456fb490d1 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:10.025455 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-a88b9146-0b73-458b-8775-e1456fb490d1 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "POST /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268132 Oct 19 00:44:10.026261 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 335/648] 10.222.0.33 () {60 vars in 1323 bytes} [Wed Oct 19 00:44:09 2022] POST /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:10.517280 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-50f5eb24-4746-4701-a07a-c22c4e2b798f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:10.517796 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-50f5eb24-4746-4701-a07a-c22c4e2b798f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:10.523651 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-50f5eb24-4746-4701-a07a-c22c4e2b798f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:10.524169 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-50f5eb24-4746-4701-a07a-c22c4e2b798f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:10.524603 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-50f5eb24-4746-4701-a07a-c22c4e2b798f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:10.525285 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-50f5eb24-4746-4701-a07a-c22c4e2b798f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:10.525737 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-50f5eb24-4746-4701-a07a-c22c4e2b798f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:10.526158 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-50f5eb24-4746-4701-a07a-c22c4e2b798f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:10.653413 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-50f5eb24-4746-4701-a07a-c22c4e2b798f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:10.661759 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-50f5eb24-4746-4701-a07a-c22c4e2b798f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1735 microversion: 2.1 time: 0.148534 Oct 19 00:44:10.662316 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 314/649] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:10 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:11.685872 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-2581f050-0749-4191-b659-e3ac415e1d47 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:11.686562 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-2581f050-0749-4191-b659-e3ac415e1d47 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:11.693894 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2581f050-0749-4191-b659-e3ac415e1d47 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:11.694368 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2581f050-0749-4191-b659-e3ac415e1d47 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:11.694808 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2581f050-0749-4191-b659-e3ac415e1d47 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:11.695520 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2581f050-0749-4191-b659-e3ac415e1d47 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:11.695967 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2581f050-0749-4191-b659-e3ac415e1d47 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:11.696385 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2581f050-0749-4191-b659-e3ac415e1d47 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:11.836338 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-2581f050-0749-4191-b659-e3ac415e1d47 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:11.846530 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-2581f050-0749-4191-b659-e3ac415e1d47 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1735 microversion: 2.1 time: 0.164802 Oct 19 00:44:11.847283 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 336/650] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:11 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:12.587549 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-a08f2e81-ebac-423b-a014-ab4947d7cad8 req-041f95bf-5bfa-4ff9-9cef-e5728c9ec328 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "8c5f2e01-9162-4cd7-9ed3-f4a558bce611", "create_info": {"type": "qcow2", "new_file": "volume-8c5f2e01-9162-4cd7-9ed3-f4a558bce611.d1942cdc-7152-4d93-b615-901b05139777.vhdx", "snapshot_id": "d1942cdc-7152-4d93-b615-901b05139777"}}} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:12.590923 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-a08f2e81-ebac-423b-a014-ab4947d7cad8 req-041f95bf-5bfa-4ff9-9cef-e5728c9ec328 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:12.591432 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-a08f2e81-ebac-423b-a014-ab4947d7cad8 req-041f95bf-5bfa-4ff9-9cef-e5728c9ec328 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:12.591886 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-a08f2e81-ebac-423b-a014-ab4947d7cad8 req-041f95bf-5bfa-4ff9-9cef-e5728c9ec328 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:12.600634 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-a08f2e81-ebac-423b-a014-ab4947d7cad8 req-041f95bf-5bfa-4ff9-9cef-e5728c9ec328 admin admin] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:12.601100 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-a08f2e81-ebac-423b-a014-ab4947d7cad8 req-041f95bf-5bfa-4ff9-9cef-e5728c9ec328 admin admin] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:12.601531 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-a08f2e81-ebac-423b-a014-ab4947d7cad8 req-041f95bf-5bfa-4ff9-9cef-e5728c9ec328 admin admin] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:12.618985 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-a08f2e81-ebac-423b-a014-ab4947d7cad8 req-041f95bf-5bfa-4ff9-9cef-e5728c9ec328 admin admin] 10.222.0.18 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.080307 Oct 19 00:44:12.619595 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 315/651] 10.222.0.18 () {64 vars in 1326 bytes} [Wed Oct 19 00:44:12 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:44:12.869817 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-7c979ae7-0cfe-4a35-a5b8-22c2bacc5a86 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:12.870469 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-7c979ae7-0cfe-4a35-a5b8-22c2bacc5a86 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:12.877839 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7c979ae7-0cfe-4a35-a5b8-22c2bacc5a86 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:12.878316 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7c979ae7-0cfe-4a35-a5b8-22c2bacc5a86 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:12.878746 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7c979ae7-0cfe-4a35-a5b8-22c2bacc5a86 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:12.879429 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7c979ae7-0cfe-4a35-a5b8-22c2bacc5a86 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:12.879901 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7c979ae7-0cfe-4a35-a5b8-22c2bacc5a86 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:12.880321 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7c979ae7-0cfe-4a35-a5b8-22c2bacc5a86 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:13.010749 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-7c979ae7-0cfe-4a35-a5b8-22c2bacc5a86 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:13.019883 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-7c979ae7-0cfe-4a35-a5b8-22c2bacc5a86 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1735 microversion: 2.1 time: 0.154081 Oct 19 00:44:13.020443 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 337/652] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:12 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:14.043803 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-95e24af4-1fe6-41c6-a471-a441ecba1d48 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:14.044536 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-95e24af4-1fe6-41c6-a471-a441ecba1d48 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:14.051213 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-95e24af4-1fe6-41c6-a471-a441ecba1d48 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:14.051695 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-95e24af4-1fe6-41c6-a471-a441ecba1d48 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:14.052163 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-95e24af4-1fe6-41c6-a471-a441ecba1d48 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:14.052860 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-95e24af4-1fe6-41c6-a471-a441ecba1d48 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:14.053358 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-95e24af4-1fe6-41c6-a471-a441ecba1d48 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:14.053813 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-95e24af4-1fe6-41c6-a471-a441ecba1d48 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:14.185564 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-95e24af4-1fe6-41c6-a471-a441ecba1d48 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:14.193874 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-95e24af4-1fe6-41c6-a471-a441ecba1d48 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1735 microversion: 2.1 time: 0.155106 Oct 19 00:44:14.194435 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 316/653] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:14 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:15.216834 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-cf1ba6a0-c93e-40d9-8c72-5ead3c56d270 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:15.217439 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-cf1ba6a0-c93e-40d9-8c72-5ead3c56d270 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:15.223807 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cf1ba6a0-c93e-40d9-8c72-5ead3c56d270 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:15.224311 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cf1ba6a0-c93e-40d9-8c72-5ead3c56d270 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:15.224741 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cf1ba6a0-c93e-40d9-8c72-5ead3c56d270 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:15.225427 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cf1ba6a0-c93e-40d9-8c72-5ead3c56d270 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:15.225872 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cf1ba6a0-c93e-40d9-8c72-5ead3c56d270 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:15.226288 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cf1ba6a0-c93e-40d9-8c72-5ead3c56d270 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:15.353588 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-cf1ba6a0-c93e-40d9-8c72-5ead3c56d270 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:15.362382 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-cf1ba6a0-c93e-40d9-8c72-5ead3c56d270 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1735 microversion: 2.1 time: 0.149331 Oct 19 00:44:15.362952 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 338/654] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:15 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:16.385982 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-284dbf98-3964-426b-b6ad-13e38c5daae8 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:16.386557 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-284dbf98-3964-426b-b6ad-13e38c5daae8 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:16.393685 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-284dbf98-3964-426b-b6ad-13e38c5daae8 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:16.394161 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-284dbf98-3964-426b-b6ad-13e38c5daae8 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:16.394597 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-284dbf98-3964-426b-b6ad-13e38c5daae8 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:16.395284 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-284dbf98-3964-426b-b6ad-13e38c5daae8 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:16.395737 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-284dbf98-3964-426b-b6ad-13e38c5daae8 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:16.396191 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-284dbf98-3964-426b-b6ad-13e38c5daae8 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:16.525823 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-284dbf98-3964-426b-b6ad-13e38c5daae8 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:16.534927 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-284dbf98-3964-426b-b6ad-13e38c5daae8 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1735 microversion: 2.1 time: 0.152891 Oct 19 00:44:16.535496 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 317/655] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:16 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:16.892038 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-ee5129df-e08c-4b47-8c93-b94cd0563e4a req-1512c154-27ac-41f5-b47b-ce0a37bbe509 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "8c5f2e01-9162-4cd7-9ed3-f4a558bce611", "create_info": {"type": "qcow2", "new_file": "volume-8c5f2e01-9162-4cd7-9ed3-f4a558bce611.924fdde9-e941-4f6e-bdde-54c5ff20172b.vhdx", "snapshot_id": "924fdde9-e941-4f6e-bdde-54c5ff20172b"}}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:16.895263 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-ee5129df-e08c-4b47-8c93-b94cd0563e4a req-1512c154-27ac-41f5-b47b-ce0a37bbe509 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:16.895745 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-ee5129df-e08c-4b47-8c93-b94cd0563e4a req-1512c154-27ac-41f5-b47b-ce0a37bbe509 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:16.896206 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-ee5129df-e08c-4b47-8c93-b94cd0563e4a req-1512c154-27ac-41f5-b47b-ce0a37bbe509 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:16.904349 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-ee5129df-e08c-4b47-8c93-b94cd0563e4a req-1512c154-27ac-41f5-b47b-ce0a37bbe509 admin admin] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:16.904818 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-ee5129df-e08c-4b47-8c93-b94cd0563e4a req-1512c154-27ac-41f5-b47b-ce0a37bbe509 admin admin] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:16.905248 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-ee5129df-e08c-4b47-8c93-b94cd0563e4a req-1512c154-27ac-41f5-b47b-ce0a37bbe509 admin admin] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:16.919116 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-ee5129df-e08c-4b47-8c93-b94cd0563e4a req-1512c154-27ac-41f5-b47b-ce0a37bbe509 admin admin] 10.222.0.18 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.077908 Oct 19 00:44:16.919689 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 339/656] 10.222.0.18 () {64 vars in 1326 bytes} [Wed Oct 19 00:44:16 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:44:17.558763 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-f38ab496-014a-41d8-b258-f76d1a017232 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:17.559362 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-f38ab496-014a-41d8-b258-f76d1a017232 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:17.566108 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f38ab496-014a-41d8-b258-f76d1a017232 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:17.566623 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f38ab496-014a-41d8-b258-f76d1a017232 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:17.567087 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f38ab496-014a-41d8-b258-f76d1a017232 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:17.567806 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f38ab496-014a-41d8-b258-f76d1a017232 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:17.568298 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f38ab496-014a-41d8-b258-f76d1a017232 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:17.568747 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f38ab496-014a-41d8-b258-f76d1a017232 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:17.584858 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell1:SELECT=100 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:17.706053 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-f38ab496-014a-41d8-b258-f76d1a017232 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:17.714471 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-f38ab496-014a-41d8-b258-f76d1a017232 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1735 microversion: 2.1 time: 0.159836 Oct 19 00:44:17.715039 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 318/657] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:17 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:18.739691 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-1ed82b2f-62de-4cba-9125-d960073814d2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:18.740433 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-1ed82b2f-62de-4cba-9125-d960073814d2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:18.746633 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1ed82b2f-62de-4cba-9125-d960073814d2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:18.747117 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1ed82b2f-62de-4cba-9125-d960073814d2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:18.747547 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1ed82b2f-62de-4cba-9125-d960073814d2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:18.748268 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1ed82b2f-62de-4cba-9125-d960073814d2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:18.748724 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1ed82b2f-62de-4cba-9125-d960073814d2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:18.749146 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1ed82b2f-62de-4cba-9125-d960073814d2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:18.879373 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-1ed82b2f-62de-4cba-9125-d960073814d2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:18.887567 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-1ed82b2f-62de-4cba-9125-d960073814d2 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1735 microversion: 2.1 time: 0.152835 Oct 19 00:44:18.888166 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 340/658] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:18 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:19.911666 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-6613a65a-0352-41e8-b3c0-ded2a6cffaf5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:19.912307 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-6613a65a-0352-41e8-b3c0-ded2a6cffaf5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:19.918659 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6613a65a-0352-41e8-b3c0-ded2a6cffaf5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:19.919135 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6613a65a-0352-41e8-b3c0-ded2a6cffaf5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:19.919565 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6613a65a-0352-41e8-b3c0-ded2a6cffaf5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:19.920276 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6613a65a-0352-41e8-b3c0-ded2a6cffaf5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:19.920726 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6613a65a-0352-41e8-b3c0-ded2a6cffaf5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:19.921146 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6613a65a-0352-41e8-b3c0-ded2a6cffaf5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:20.049392 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-6613a65a-0352-41e8-b3c0-ded2a6cffaf5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:20.057696 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-6613a65a-0352-41e8-b3c0-ded2a6cffaf5 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1735 microversion: 2.1 time: 0.151046 Oct 19 00:44:20.058255 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 319/659] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:19 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:21.079619 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-38e77186-9b66-4156-b387-57a8350164cb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:21.080286 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-38e77186-9b66-4156-b387-57a8350164cb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:21.086711 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-38e77186-9b66-4156-b387-57a8350164cb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:21.087195 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-38e77186-9b66-4156-b387-57a8350164cb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:21.087635 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-38e77186-9b66-4156-b387-57a8350164cb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:21.088363 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-38e77186-9b66-4156-b387-57a8350164cb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:21.088824 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-38e77186-9b66-4156-b387-57a8350164cb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:21.089250 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-38e77186-9b66-4156-b387-57a8350164cb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:21.216205 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-38e77186-9b66-4156-b387-57a8350164cb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:21.225648 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-38e77186-9b66-4156-b387-57a8350164cb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1715 microversion: 2.1 time: 0.149918 Oct 19 00:44:21.226211 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 341/660] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:21 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1715 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:21.334833 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-9c9e7056-8e66-4cda-b58c-261f55eaecba tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:21.335317 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-9c9e7056-8e66-4cda-b58c-261f55eaecba tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:21.341972 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9c9e7056-8e66-4cda-b58c-261f55eaecba tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:21.342447 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9c9e7056-8e66-4cda-b58c-261f55eaecba tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:21.342876 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9c9e7056-8e66-4cda-b58c-261f55eaecba tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:21.343557 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9c9e7056-8e66-4cda-b58c-261f55eaecba tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:21.344034 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9c9e7056-8e66-4cda-b58c-261f55eaecba tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:21.344454 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9c9e7056-8e66-4cda-b58c-261f55eaecba tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:21.423972 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.wsgi [None req-9c9e7056-8e66-4cda-b58c-261f55eaecba tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] HTTP exception thrown: Cannot 'detach_volume' instance 4b862704-38e5-4ea8-9fa2-741591535b6f while it is in vm_state rescued Oct 19 00:44:21.425571 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-9c9e7056-8e66-4cda-b58c-261f55eaecba tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Request method failure captured: Oct 19 00:44:21.425571 dv-cinder-master-3-smb devstack@n-api.service[125531]: request: DELETE /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f/os-volume_attachments/e5c90d3e-3b9a-44e2-a1b5-5a7829829712 HTTP/1.1 Oct 19 00:44:21.425571 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept: application/json Oct 19 00:44:21.425571 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept-Encoding: identity Oct 19 00:44:21.425571 dv-cinder-master-3-smb devstack@n-api.service[125531]: Connection: close Oct 19 00:44:21.425571 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Length: 0 Oct 19 00:44:21.425571 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Type: application/json Oct 19 00:44:21.425571 dv-cinder-master-3-smb devstack@n-api.service[125531]: Host: 10.222.0.33 Oct 19 00:44:21.425571 dv-cinder-master-3-smb devstack@n-api.service[125531]: Openstack-System-Scope: None Oct 19 00:44:21.425571 dv-cinder-master-3-smb devstack@n-api.service[125531]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:21.425571 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Auth-Token: gAAAAABjT0dZ_4FF8isbZtl7c5-GdMjgtdkzBRByQoOzSTUxRPm0NU1bMkTSg3nCD_LApNQSolFnUFcfFlewlCxUoOsWoj9qCOzOsCRlZMSRn6X12ufFgLR_KoHBG97yFQ-9UyMgZvW2127GxTVAcAuSg_loWUS1yl5fwx-10demwDus7CXkRQ8 Oct 19 00:44:21.425571 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Id: None Oct 19 00:44:21.425571 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Name: None Oct 19 00:44:21.425571 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Identity-Status: Confirmed Oct 19 00:44:21.425571 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Is-Admin-Project: True Oct 19 00:44:21.425571 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Id: default Oct 19 00:44:21.425571 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Name: Default Oct 19 00:44:21.425571 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Id: 5a230211180742ef9efd4d62b630d211 Oct 19 00:44:21.425571 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-748606272 Oct 19 00:44:21.425571 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Role: member,reader Oct 19 00:44:21.425571 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Roles: member,reader Oct 19 00:44:21.427196 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a230211180742ef9efd4d62b630d211"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a230211180742ef9efd4d62b630d211"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a230211180742ef9efd4d62b630d211"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a230211180742ef9efd4d62b630d211"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:44:21.427196 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant: tempest-ServerRescueNegativeTestJSON-748606272 Oct 19 00:44:21.427196 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Id: 5a230211180742ef9efd4d62b630d211 Oct 19 00:44:21.427196 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-748606272 Oct 19 00:44:21.427196 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User: tempest-ServerRescueNegativeTestJSON-748606272-project Oct 19 00:44:21.427196 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Id: default Oct 19 00:44:21.427196 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Name: Default Oct 19 00:44:21.427196 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Id: 5628a861c90042d88b95f2d7b898ed52 Oct 19 00:44:21.427196 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Name: tempest-ServerRescueNegativeTestJSON-748606272-project Oct 19 00:44:21.427196 dv-cinder-master-3-smb devstack@n-api.service[125531]: method: > Oct 19 00:44:21.427196 dv-cinder-master-3-smb devstack@n-api.service[125531]: exception: Cannot 'detach_volume' instance 4b862704-38e5-4ea8-9fa2-741591535b6f while it is in vm_state rescued Oct 19 00:44:21.428080 dv-cinder-master-3-smb devstack@n-api.service[125531]: action_args: {'server_id': '4b862704-38e5-4ea8-9fa2-741591535b6f', 'id': 'e5c90d3e-3b9a-44e2-a1b5-5a7829829712'} Oct 19 00:44:21.428080 dv-cinder-master-3-smb devstack@n-api.service[125531]: {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:21.428080 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:21.428080 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 19 00:44:21.428080 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 19 00:44:21.428080 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 00:44:21.428080 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 00:44:21.428080 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 00:44:21.428080 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 00:44:21.428080 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4b862704-38e5-4ea8-9fa2-741591535b6f in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 19 00:44:21.428080 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:44:21.428080 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:21.428080 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:44:21.428080 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:21.428080 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:21.428080 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:21.428080 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:21.428080 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:21.428080 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:21.428080 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:21.429599 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 19 00:44:21.429599 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 00:44:21.429599 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 00:44:21.429599 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 00:44:21.429599 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4b862704-38e5-4ea8-9fa2-741591535b6f while it is in vm_state rescued Oct 19 00:44:21.429599 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:44:21.429599 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:21.429599 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:44:21.429599 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:21.429599 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:21.429599 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:21.429599 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:44:21.429599 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:44:21.429599 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4b862704-38e5-4ea8-9fa2-741591535b6f while it is in vm_state rescued Oct 19 00:44:21.429599 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:44:21.429599 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-9c9e7056-8e66-4cda-b58c-261f55eaecba tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Returning 409 to user: Cannot 'detach_volume' instance 4b862704-38e5-4ea8-9fa2-741591535b6f while it is in vm_state rescued {{(pid=125531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:21.430779 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-9c9e7056-8e66-4cda-b58c-261f55eaecba tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f/os-volume_attachments/e5c90d3e-3b9a-44e2-a1b5-5a7829829712" status: 409 len: 152 microversion: 2.1 time: 0.096187 Oct 19 00:44:21.430779 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 320/661] 10.222.0.33 () {58 vars in 1416 bytes} [Wed Oct 19 00:44:21 2022] DELETE /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f/os-volume_attachments/e5c90d3e-3b9a-44e2-a1b5-5a7829829712 => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:44:21.435829 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-31040fa6-9b8f-4059-ace3-69a5c467115e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:21.436375 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-31040fa6-9b8f-4059-ace3-69a5c467115e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:21.442211 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-31040fa6-9b8f-4059-ace3-69a5c467115e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:21.442713 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-31040fa6-9b8f-4059-ace3-69a5c467115e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:21.443143 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-31040fa6-9b8f-4059-ace3-69a5c467115e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:21.443822 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-31040fa6-9b8f-4059-ace3-69a5c467115e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:21.444300 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-31040fa6-9b8f-4059-ace3-69a5c467115e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:21.444719 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-31040fa6-9b8f-4059-ace3-69a5c467115e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:21.509683 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-31040fa6-9b8f-4059-ace3-69a5c467115e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "POST /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f/action" status: 202 len: 0 microversion: 2.1 time: 0.077506 Oct 19 00:44:21.510295 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 342/662] 10.222.0.33 () {60 vars in 1278 bytes} [Wed Oct 19 00:44:21 2022] POST /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:44:21.519210 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-2f212ad3-cb69-47fc-905e-56958929c505 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:21.519848 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-2f212ad3-cb69-47fc-905e-56958929c505 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:21.525986 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2f212ad3-cb69-47fc-905e-56958929c505 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:21.526475 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2f212ad3-cb69-47fc-905e-56958929c505 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:21.526935 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2f212ad3-cb69-47fc-905e-56958929c505 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:21.527701 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2f212ad3-cb69-47fc-905e-56958929c505 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:21.528212 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2f212ad3-cb69-47fc-905e-56958929c505 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:21.528638 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2f212ad3-cb69-47fc-905e-56958929c505 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:21.664992 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-2f212ad3-cb69-47fc-905e-56958929c505 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:21.673706 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-2f212ad3-cb69-47fc-905e-56958929c505 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1723 microversion: 2.1 time: 0.158374 Oct 19 00:44:21.674275 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 321/663] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:21 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:22.046505 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-8dc39061-f7c9-4020-8692-419d31a0e0c1 req-f9156e10-4727-40ee-891b-de3061a45ae0 admin admin] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:22.051796 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-8dc39061-f7c9-4020-8692-419d31a0e0c1 req-f9156e10-4727-40ee-891b-de3061a45ae0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:22.052305 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-8dc39061-f7c9-4020-8692-419d31a0e0c1 req-f9156e10-4727-40ee-891b-de3061a45ae0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:22.052733 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-8dc39061-f7c9-4020-8692-419d31a0e0c1 req-f9156e10-4727-40ee-891b-de3061a45ae0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:22.061063 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-8dc39061-f7c9-4020-8692-419d31a0e0c1 req-f9156e10-4727-40ee-891b-de3061a45ae0 admin admin] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:22.061535 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-8dc39061-f7c9-4020-8692-419d31a0e0c1 req-f9156e10-4727-40ee-891b-de3061a45ae0 admin admin] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:22.061962 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-8dc39061-f7c9-4020-8692-419d31a0e0c1 req-f9156e10-4727-40ee-891b-de3061a45ae0 admin admin] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:22.075574 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-8dc39061-f7c9-4020-8692-419d31a0e0c1 req-f9156e10-4727-40ee-891b-de3061a45ae0 admin admin] 10.222.0.18 "DELETE /compute/v2.1/os-assisted-volume-snapshots/924fdde9-e941-4f6e-bdde-54c5ff20172b?delete_info=%7B%22file_to_merge%22:%20%22volume-8c5f2e01-9162-4cd7-9ed3-f4a558bce611.924fdde9-e941-4f6e-bdde-54c5ff20172b.vhdx%22,%20%22volume_id%22:%20%228c5f2e01-9162-4cd7-9ed3-f4a558bce611%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.086396 Oct 19 00:44:22.076197 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 343/664] 10.222.0.18 () {62 vars in 1800 bytes} [Wed Oct 19 00:44:21 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/924fdde9-e941-4f6e-bdde-54c5ff20172b?delete_info=%7B%22file_to_merge%22:%20%22volume-8c5f2e01-9162-4cd7-9ed3-f4a558bce611.924fdde9-e941-4f6e-bdde-54c5ff20172b.vhdx%22,%20%22volume_id%22:%20%228c5f2e01-9162-4cd7-9ed3-f4a558bce611%22%7D => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:44:22.697296 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-9ec6f1ab-a1cf-45d5-8221-c2242bcda98d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:22.697909 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-9ec6f1ab-a1cf-45d5-8221-c2242bcda98d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:22.700275 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell0:SELECT=2 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:22.705545 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9ec6f1ab-a1cf-45d5-8221-c2242bcda98d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:22.706024 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9ec6f1ab-a1cf-45d5-8221-c2242bcda98d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:22.706463 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9ec6f1ab-a1cf-45d5-8221-c2242bcda98d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:22.707154 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9ec6f1ab-a1cf-45d5-8221-c2242bcda98d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:22.707608 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9ec6f1ab-a1cf-45d5-8221-c2242bcda98d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:22.708072 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9ec6f1ab-a1cf-45d5-8221-c2242bcda98d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:22.836432 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-9ec6f1ab-a1cf-45d5-8221-c2242bcda98d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:22.844603 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-9ec6f1ab-a1cf-45d5-8221-c2242bcda98d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1723 microversion: 2.1 time: 0.151162 Oct 19 00:44:22.845371 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 322/665] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:22 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:23.869143 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-d3ee7a7e-242f-4f11-a938-dea15e3bdb26 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:23.869771 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-d3ee7a7e-242f-4f11-a938-dea15e3bdb26 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:23.876823 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d3ee7a7e-242f-4f11-a938-dea15e3bdb26 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:23.877654 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d3ee7a7e-242f-4f11-a938-dea15e3bdb26 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:23.878088 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d3ee7a7e-242f-4f11-a938-dea15e3bdb26 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:23.878775 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d3ee7a7e-242f-4f11-a938-dea15e3bdb26 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:23.879223 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d3ee7a7e-242f-4f11-a938-dea15e3bdb26 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:23.879644 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d3ee7a7e-242f-4f11-a938-dea15e3bdb26 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:24.013705 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-d3ee7a7e-242f-4f11-a938-dea15e3bdb26 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:24.022393 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-d3ee7a7e-242f-4f11-a938-dea15e3bdb26 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1723 microversion: 2.1 time: 0.158294 Oct 19 00:44:24.022958 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 344/666] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:23 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:25.045582 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-41f15be6-201a-4e42-88c2-64fad4e3d0f7 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:25.046196 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-41f15be6-201a-4e42-88c2-64fad4e3d0f7 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:25.052622 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-41f15be6-201a-4e42-88c2-64fad4e3d0f7 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:25.053109 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-41f15be6-201a-4e42-88c2-64fad4e3d0f7 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:25.053546 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-41f15be6-201a-4e42-88c2-64fad4e3d0f7 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:25.054230 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-41f15be6-201a-4e42-88c2-64fad4e3d0f7 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:25.054754 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-41f15be6-201a-4e42-88c2-64fad4e3d0f7 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:25.055108 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-41f15be6-201a-4e42-88c2-64fad4e3d0f7 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:25.180218 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-41f15be6-201a-4e42-88c2-64fad4e3d0f7 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:25.188542 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-41f15be6-201a-4e42-88c2-64fad4e3d0f7 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1723 microversion: 2.1 time: 0.146748 Oct 19 00:44:25.189120 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 323/667] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:25 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:26.212236 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-28f2fa1b-c9cf-4192-9df2-c091bca4edba tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:26.212848 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-28f2fa1b-c9cf-4192-9df2-c091bca4edba tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:26.219308 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-28f2fa1b-c9cf-4192-9df2-c091bca4edba tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:26.220434 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-28f2fa1b-c9cf-4192-9df2-c091bca4edba tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:26.220814 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-28f2fa1b-c9cf-4192-9df2-c091bca4edba tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:26.221533 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-28f2fa1b-c9cf-4192-9df2-c091bca4edba tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:26.221985 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-28f2fa1b-c9cf-4192-9df2-c091bca4edba tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:26.222465 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-28f2fa1b-c9cf-4192-9df2-c091bca4edba tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:26.237651 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:26.351896 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-28f2fa1b-c9cf-4192-9df2-c091bca4edba tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:26.360098 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-28f2fa1b-c9cf-4192-9df2-c091bca4edba tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1723 microversion: 2.1 time: 0.151725 Oct 19 00:44:26.361241 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 345/668] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:26 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:27.383614 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-fa1af4f9-d84e-44da-afbe-da3747aa0f01 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:27.384256 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-fa1af4f9-d84e-44da-afbe-da3747aa0f01 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:27.390597 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fa1af4f9-d84e-44da-afbe-da3747aa0f01 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:27.391075 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fa1af4f9-d84e-44da-afbe-da3747aa0f01 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:27.391510 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fa1af4f9-d84e-44da-afbe-da3747aa0f01 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:27.392220 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fa1af4f9-d84e-44da-afbe-da3747aa0f01 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:27.393440 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fa1af4f9-d84e-44da-afbe-da3747aa0f01 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:27.393872 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fa1af4f9-d84e-44da-afbe-da3747aa0f01 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:27.526292 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-fa1af4f9-d84e-44da-afbe-da3747aa0f01 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:27.535232 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-fa1af4f9-d84e-44da-afbe-da3747aa0f01 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1729 microversion: 2.1 time: 0.155517 Oct 19 00:44:27.535792 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 324/669] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:27 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:27.557144 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-9c315b1b-7422-498e-8f02-90db818f2792 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:27.557665 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-9c315b1b-7422-498e-8f02-90db818f2792 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:27.559950 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_api:SELECT=48 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:27.565842 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9c315b1b-7422-498e-8f02-90db818f2792 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:27.566323 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9c315b1b-7422-498e-8f02-90db818f2792 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:27.566759 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9c315b1b-7422-498e-8f02-90db818f2792 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:27.567477 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9c315b1b-7422-498e-8f02-90db818f2792 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:27.567996 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9c315b1b-7422-498e-8f02-90db818f2792 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:27.568465 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9c315b1b-7422-498e-8f02-90db818f2792 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:27.648298 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-9c315b1b-7422-498e-8f02-90db818f2792 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094930 Oct 19 00:44:27.648912 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 346/670] 10.222.0.33 () {58 vars in 1275 bytes} [Wed Oct 19 00:44:27 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:28.285402 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-654c6bef-0b2c-4428-9b71-128177fec19d req-f9658292-81e3-44e3-945a-1cf1bd8a64f8 admin admin] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:28.288760 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-654c6bef-0b2c-4428-9b71-128177fec19d req-f9658292-81e3-44e3-945a-1cf1bd8a64f8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:28.289238 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-654c6bef-0b2c-4428-9b71-128177fec19d req-f9658292-81e3-44e3-945a-1cf1bd8a64f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:28.289666 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-654c6bef-0b2c-4428-9b71-128177fec19d req-f9658292-81e3-44e3-945a-1cf1bd8a64f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:28.297763 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-654c6bef-0b2c-4428-9b71-128177fec19d req-f9658292-81e3-44e3-945a-1cf1bd8a64f8 admin admin] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:28.298225 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-654c6bef-0b2c-4428-9b71-128177fec19d req-f9658292-81e3-44e3-945a-1cf1bd8a64f8 admin admin] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:28.298646 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-654c6bef-0b2c-4428-9b71-128177fec19d req-f9658292-81e3-44e3-945a-1cf1bd8a64f8 admin admin] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:28.313675 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-654c6bef-0b2c-4428-9b71-128177fec19d req-f9658292-81e3-44e3-945a-1cf1bd8a64f8 admin admin] 10.222.0.18 "DELETE /compute/v2.1/os-assisted-volume-snapshots/0d469999-503f-4766-8b32-c979b5dff82f?delete_info=%7B%22file_to_merge%22:%20%22volume-8c5f2e01-9162-4cd7-9ed3-f4a558bce611.0d469999-503f-4766-8b32-c979b5dff82f.vhdx%22,%20%22volume_id%22:%20%228c5f2e01-9162-4cd7-9ed3-f4a558bce611%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.079816 Oct 19 00:44:28.314289 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 325/671] 10.222.0.18 () {62 vars in 1800 bytes} [Wed Oct 19 00:44:28 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/0d469999-503f-4766-8b32-c979b5dff82f?delete_info=%7B%22file_to_merge%22:%20%22volume-8c5f2e01-9162-4cd7-9ed3-f4a558bce611.0d469999-503f-4766-8b32-c979b5dff82f.vhdx%22,%20%22volume_id%22:%20%228c5f2e01-9162-4cd7-9ed3-f4a558bce611%22%7D => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:44:28.775134 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-8060dd94-023d-4551-8e96-e2d25add0737 req-f95e4e2f-4b49-4c08-a9ab-fb6bbb5202b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b862704-38e5-4ea8-9fa2-741591535b6f", "tag": "1d63aec2-4f59-4c65-8d08-0a5e740a5e12"}]} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:28.785134 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-8060dd94-023d-4551-8e96-e2d25add0737 req-f95e4e2f-4b49-4c08-a9ab-fb6bbb5202b9 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:28.785617 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-8060dd94-023d-4551-8e96-e2d25add0737 req-f95e4e2f-4b49-4c08-a9ab-fb6bbb5202b9 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:28.786075 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-8060dd94-023d-4551-8e96-e2d25add0737 req-f95e4e2f-4b49-4c08-a9ab-fb6bbb5202b9 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:28.800829 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.compute.server_external_events [req-8060dd94-023d-4551-8e96-e2d25add0737 req-f95e4e2f-4b49-4c08-a9ab-fb6bbb5202b9 service nova] Creating event network-changed:1d63aec2-4f59-4c65-8d08-0a5e740a5e12 for instance 4b862704-38e5-4ea8-9fa2-741591535b6f on hv-cinder-maste Oct 19 00:44:28.804507 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-8060dd94-023d-4551-8e96-e2d25add0737 req-f95e4e2f-4b49-4c08-a9ab-fb6bbb5202b9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033522 Oct 19 00:44:28.805106 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 347/672] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:30.820337 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-7a7402a1-8935-47cb-a392-a31eb76ea9df req-02ba27ca-d0e3-444f-823b-946a8aaadf62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b862704-38e5-4ea8-9fa2-741591535b6f", "tag": "1d63aec2-4f59-4c65-8d08-0a5e740a5e12"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:30.825207 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_api:SELECT=52 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:30.832617 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-7a7402a1-8935-47cb-a392-a31eb76ea9df req-02ba27ca-d0e3-444f-823b-946a8aaadf62 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:30.833094 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-7a7402a1-8935-47cb-a392-a31eb76ea9df req-02ba27ca-d0e3-444f-823b-946a8aaadf62 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:30.833524 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-7a7402a1-8935-47cb-a392-a31eb76ea9df req-02ba27ca-d0e3-444f-823b-946a8aaadf62 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:30.843710 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-7a7402a1-8935-47cb-a392-a31eb76ea9df req-02ba27ca-d0e3-444f-823b-946a8aaadf62 service nova] Creating event network-changed:1d63aec2-4f59-4c65-8d08-0a5e740a5e12 for instance 4b862704-38e5-4ea8-9fa2-741591535b6f on hv-cinder-maste Oct 19 00:44:30.848633 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-7a7402a1-8935-47cb-a392-a31eb76ea9df req-02ba27ca-d0e3-444f-823b-946a8aaadf62 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032955 Oct 19 00:44:30.849205 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 326/673] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:32.416650 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell0:SELECT=4 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:32.466391 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-8e745c6a-0559-4ddc-a3b4-6e450e440377 req-8c39a042-065a-470c-a66b-004a1deec46c admin admin] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:32.469635 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-8e745c6a-0559-4ddc-a3b4-6e450e440377 req-8c39a042-065a-470c-a66b-004a1deec46c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:32.470182 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-8e745c6a-0559-4ddc-a3b4-6e450e440377 req-8c39a042-065a-470c-a66b-004a1deec46c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:32.470641 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-8e745c6a-0559-4ddc-a3b4-6e450e440377 req-8c39a042-065a-470c-a66b-004a1deec46c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:32.478892 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-8e745c6a-0559-4ddc-a3b4-6e450e440377 req-8c39a042-065a-470c-a66b-004a1deec46c admin admin] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:32.479355 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-8e745c6a-0559-4ddc-a3b4-6e450e440377 req-8c39a042-065a-470c-a66b-004a1deec46c admin admin] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:32.479782 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-8e745c6a-0559-4ddc-a3b4-6e450e440377 req-8c39a042-065a-470c-a66b-004a1deec46c admin admin] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:32.493658 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-8e745c6a-0559-4ddc-a3b4-6e450e440377 req-8c39a042-065a-470c-a66b-004a1deec46c admin admin] 10.222.0.18 "DELETE /compute/v2.1/os-assisted-volume-snapshots/d1942cdc-7152-4d93-b615-901b05139777?delete_info=%7B%22file_to_merge%22:%20%22volume-8c5f2e01-9162-4cd7-9ed3-f4a558bce611.d1942cdc-7152-4d93-b615-901b05139777.vhdx%22,%20%22volume_id%22:%20%228c5f2e01-9162-4cd7-9ed3-f4a558bce611%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.078220 Oct 19 00:44:32.494231 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 348/674] 10.222.0.18 () {62 vars in 1800 bytes} [Wed Oct 19 00:44:32 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/d1942cdc-7152-4d93-b615-901b05139777?delete_info=%7B%22file_to_merge%22:%20%22volume-8c5f2e01-9162-4cd7-9ed3-f4a558bce611.d1942cdc-7152-4d93-b615-901b05139777.vhdx%22,%20%22volume_id%22:%20%228c5f2e01-9162-4cd7-9ed3-f4a558bce611%22%7D => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 00:44:36.452504 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-786f65cd-fa95-42e0-96c4-3f7ee6f820a4 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:36.453089 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-786f65cd-fa95-42e0-96c4-3f7ee6f820a4 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:36.459147 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-786f65cd-fa95-42e0-96c4-3f7ee6f820a4 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:36.459629 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-786f65cd-fa95-42e0-96c4-3f7ee6f820a4 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:36.460165 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-786f65cd-fa95-42e0-96c4-3f7ee6f820a4 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:36.460853 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-786f65cd-fa95-42e0-96c4-3f7ee6f820a4 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:36.461308 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-786f65cd-fa95-42e0-96c4-3f7ee6f820a4 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:36.461749 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-786f65cd-fa95-42e0-96c4-3f7ee6f820a4 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:36.544019 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.objects.instance [None req-786f65cd-fa95-42e0-96c4-3f7ee6f820a4 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lazy-loading 'services' on Instance uuid 669ba27e-389e-4b04-959f-322c738a17df {{(pid=125531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:44:36.623263 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-786f65cd-fa95-42e0-96c4-3f7ee6f820a4 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "DELETE /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df/os-volume_attachments/8c5f2e01-9162-4cd7-9ed3-f4a558bce611" status: 202 len: 0 microversion: 2.1 time: 0.175372 Oct 19 00:44:36.623884 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 327/675] 10.222.0.33 () {58 vars in 1416 bytes} [Wed Oct 19 00:44:36 2022] DELETE /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df/os-volume_attachments/8c5f2e01-9162-4cd7-9ed3-f4a558bce611 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:44:38.805789 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_api:SELECT=3 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:38.809984 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-44423b90-054d-47f4-a742-47389d5163c9 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:38.810558 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-44423b90-054d-47f4-a742-47389d5163c9 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:38.817986 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-44423b90-054d-47f4-a742-47389d5163c9 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:38.818456 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-44423b90-054d-47f4-a742-47389d5163c9 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:38.818881 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-44423b90-054d-47f4-a742-47389d5163c9 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:38.819593 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-44423b90-054d-47f4-a742-47389d5163c9 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:38.820085 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-44423b90-054d-47f4-a742-47389d5163c9 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:38.820505 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-44423b90-054d-47f4-a742-47389d5163c9 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:38.847095 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-44423b90-054d-47f4-a742-47389d5163c9 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Going to try to terminate instance {{(pid=125532) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:44:38.919139 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-44423b90-054d-47f4-a742-47389d5163c9 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "DELETE /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 204 len: 0 microversion: 2.1 time: 0.114558 Oct 19 00:44:38.919675 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 349/676] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Oct 19 00:44:38 2022] DELETE /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:44:38.926527 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell0:SELECT=2 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:38.931174 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-eb18492b-db28-4649-a25d-10cf73fc9cc2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:38.931929 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-eb18492b-db28-4649-a25d-10cf73fc9cc2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:38.938436 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-eb18492b-db28-4649-a25d-10cf73fc9cc2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:38.938919 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-eb18492b-db28-4649-a25d-10cf73fc9cc2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:38.939360 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-eb18492b-db28-4649-a25d-10cf73fc9cc2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:38.940097 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-eb18492b-db28-4649-a25d-10cf73fc9cc2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:38.940583 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-eb18492b-db28-4649-a25d-10cf73fc9cc2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:38.941016 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-eb18492b-db28-4649-a25d-10cf73fc9cc2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:39.118917 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-eb18492b-db28-4649-a25d-10cf73fc9cc2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:39.126605 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-eb18492b-db28-4649-a25d-10cf73fc9cc2 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1514 microversion: 2.1 time: 0.202454 Oct 19 00:44:39.127170 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 328/677] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:38 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1514 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:40.149511 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-046cd2e6-1072-4b95-9219-421df7919522 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:40.150207 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-046cd2e6-1072-4b95-9219-421df7919522 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:40.156560 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-046cd2e6-1072-4b95-9219-421df7919522 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:40.157038 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-046cd2e6-1072-4b95-9219-421df7919522 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:40.157465 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-046cd2e6-1072-4b95-9219-421df7919522 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:40.158141 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-046cd2e6-1072-4b95-9219-421df7919522 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:40.158584 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-046cd2e6-1072-4b95-9219-421df7919522 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:40.158997 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-046cd2e6-1072-4b95-9219-421df7919522 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:40.335256 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-046cd2e6-1072-4b95-9219-421df7919522 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:40.343592 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-046cd2e6-1072-4b95-9219-421df7919522 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1514 microversion: 2.1 time: 0.198256 Oct 19 00:44:40.344197 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 350/678] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:40 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1514 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:41.367616 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-1c341fb5-4ff9-485f-a70d-a4800f431e68 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:41.368264 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-1c341fb5-4ff9-485f-a70d-a4800f431e68 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:41.374843 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1c341fb5-4ff9-485f-a70d-a4800f431e68 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:41.375319 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1c341fb5-4ff9-485f-a70d-a4800f431e68 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:41.375748 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1c341fb5-4ff9-485f-a70d-a4800f431e68 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:41.376448 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1c341fb5-4ff9-485f-a70d-a4800f431e68 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:41.376893 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1c341fb5-4ff9-485f-a70d-a4800f431e68 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:41.377320 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1c341fb5-4ff9-485f-a70d-a4800f431e68 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:41.508345 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-1c341fb5-4ff9-485f-a70d-a4800f431e68 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:41.515996 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-1c341fb5-4ff9-485f-a70d-a4800f431e68 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1514 microversion: 2.1 time: 0.152487 Oct 19 00:44:41.516559 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 329/679] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:41 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:42.539236 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-8f15bd27-3975-4457-9321-ce04872a06f6 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:42.539846 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-8f15bd27-3975-4457-9321-ce04872a06f6 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:42.542286 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell0:SELECT=2 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:42.548020 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8f15bd27-3975-4457-9321-ce04872a06f6 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:42.548507 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8f15bd27-3975-4457-9321-ce04872a06f6 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:42.548944 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8f15bd27-3975-4457-9321-ce04872a06f6 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:42.549638 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8f15bd27-3975-4457-9321-ce04872a06f6 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:42.550095 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8f15bd27-3975-4457-9321-ce04872a06f6 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:42.550684 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8f15bd27-3975-4457-9321-ce04872a06f6 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:42.682509 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-8f15bd27-3975-4457-9321-ce04872a06f6 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:42.690792 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-8f15bd27-3975-4457-9321-ce04872a06f6 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1514 microversion: 2.1 time: 0.154883 Oct 19 00:44:42.691380 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 351/680] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:42 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:43.720360 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-c0edd84e-8cc9-477a-b583-39c3e9d1cb00 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:43.720978 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-c0edd84e-8cc9-477a-b583-39c3e9d1cb00 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:43.728588 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c0edd84e-8cc9-477a-b583-39c3e9d1cb00 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:43.729066 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c0edd84e-8cc9-477a-b583-39c3e9d1cb00 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:43.729497 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c0edd84e-8cc9-477a-b583-39c3e9d1cb00 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:43.730186 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c0edd84e-8cc9-477a-b583-39c3e9d1cb00 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:43.730728 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c0edd84e-8cc9-477a-b583-39c3e9d1cb00 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:43.731146 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c0edd84e-8cc9-477a-b583-39c3e9d1cb00 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:43.865482 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-c0edd84e-8cc9-477a-b583-39c3e9d1cb00 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:43.873292 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-c0edd84e-8cc9-477a-b583-39c3e9d1cb00 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1514 microversion: 2.1 time: 0.156832 Oct 19 00:44:43.873789 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 330/681] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:43 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:44.897345 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-64ff93e3-1029-4f21-9c04-e389af6c05ac tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:44.897874 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-64ff93e3-1029-4f21-9c04-e389af6c05ac tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:44.904113 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-64ff93e3-1029-4f21-9c04-e389af6c05ac tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:44.904592 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-64ff93e3-1029-4f21-9c04-e389af6c05ac tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:44.905018 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-64ff93e3-1029-4f21-9c04-e389af6c05ac tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:44.905706 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-64ff93e3-1029-4f21-9c04-e389af6c05ac tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:44.906160 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-64ff93e3-1029-4f21-9c04-e389af6c05ac tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:44.906579 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-64ff93e3-1029-4f21-9c04-e389af6c05ac tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:45.112489 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-64ff93e3-1029-4f21-9c04-e389af6c05ac tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb1e83f51a384b7d9d044bce87f00990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b24d4afc5104b359924acdf4619cfc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:45.120708 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-64ff93e3-1029-4f21-9c04-e389af6c05ac tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 200 len: 1514 microversion: 2.1 time: 0.228021 Oct 19 00:44:45.121289 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 352/682] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:44 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 1514 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:45.222310 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-76cc84e0-a91b-4b2c-9607-fa518cb2cb63 req-08565968-9d1c-4cb5-931e-e469a974f7ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "669ba27e-389e-4b04-959f-322c738a17df", "name": "network-vif-deleted", "tag": "7357b679-ddd1-40f3-87a5-7d660205f2e1"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:45.234239 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-76cc84e0-a91b-4b2c-9607-fa518cb2cb63 req-08565968-9d1c-4cb5-931e-e469a974f7ca service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:45.234710 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-76cc84e0-a91b-4b2c-9607-fa518cb2cb63 req-08565968-9d1c-4cb5-931e-e469a974f7ca service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:45.235133 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-76cc84e0-a91b-4b2c-9607-fa518cb2cb63 req-08565968-9d1c-4cb5-931e-e469a974f7ca service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:45.247468 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-76cc84e0-a91b-4b2c-9607-fa518cb2cb63 req-08565968-9d1c-4cb5-931e-e469a974f7ca service nova] Creating event network-vif-deleted:7357b679-ddd1-40f3-87a5-7d660205f2e1 for instance 669ba27e-389e-4b04-959f-322c738a17df on hv-cinder-maste Oct 19 00:44:45.253163 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-76cc84e0-a91b-4b2c-9607-fa518cb2cb63 req-08565968-9d1c-4cb5-931e-e469a974f7ca service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034214 Oct 19 00:44:45.254650 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 331/683] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:46.144239 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-eaa79815-ddb7-4d78-846a-48970301aa63 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:46.145984 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-eaa79815-ddb7-4d78-846a-48970301aa63 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] [instance: 669ba27e-389e-4b04-959f-322c738a17df] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:46.152590 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-eaa79815-ddb7-4d78-846a-48970301aa63 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:46.153061 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-eaa79815-ddb7-4d78-846a-48970301aa63 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:46.153490 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-eaa79815-ddb7-4d78-846a-48970301aa63 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:46.154278 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-eaa79815-ddb7-4d78-846a-48970301aa63 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:46.154721 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-eaa79815-ddb7-4d78-846a-48970301aa63 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:46.155133 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-eaa79815-ddb7-4d78-846a-48970301aa63 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:46.169305 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.wsgi [None req-eaa79815-ddb7-4d78-846a-48970301aa63 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] HTTP exception thrown: Instance 669ba27e-389e-4b04-959f-322c738a17df could not be found. Oct 19 00:44:46.170921 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-eaa79815-ddb7-4d78-846a-48970301aa63 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Request method failure captured: Oct 19 00:44:46.170921 dv-cinder-master-3-smb devstack@n-api.service[125532]: request: GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df HTTP/1.1 Oct 19 00:44:46.170921 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept: application/json Oct 19 00:44:46.170921 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept-Encoding: identity Oct 19 00:44:46.170921 dv-cinder-master-3-smb devstack@n-api.service[125532]: Connection: close Oct 19 00:44:46.170921 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Length: 0 Oct 19 00:44:46.170921 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Type: application/json Oct 19 00:44:46.170921 dv-cinder-master-3-smb devstack@n-api.service[125532]: Host: 10.222.0.33 Oct 19 00:44:46.170921 dv-cinder-master-3-smb devstack@n-api.service[125532]: Openstack-System-Scope: None Oct 19 00:44:46.170921 dv-cinder-master-3-smb devstack@n-api.service[125532]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:46.170921 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Auth-Token: gAAAAABjT0fIlnlAjgiUNTzu88rFt85fe39D8Pklz9QJEAoNGsXRuuTB9wKhzgQE3FhRultcU3Cw-cFvapTBojzVSw9lyJNAipNyoCjtbYUlq7QjmDRnS9vmi3OzfiyulnLIH5t3dcmklnLwjruy65RLWBlzUfJI5VtIdvqS8w3yHz8QFzoK7I0 Oct 19 00:44:46.170921 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Id: None Oct 19 00:44:46.170921 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Name: None Oct 19 00:44:46.170921 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Identity-Status: Confirmed Oct 19 00:44:46.170921 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Is-Admin-Project: True Oct 19 00:44:46.170921 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Id: default Oct 19 00:44:46.170921 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Name: Default Oct 19 00:44:46.170921 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Id: 3b24d4afc5104b359924acdf4619cfc7 Oct 19 00:44:46.170921 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1763949199 Oct 19 00:44:46.170921 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Role: member,reader Oct 19 00:44:46.170921 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Roles: member,reader Oct 19 00:44:46.172484 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3b24d4afc5104b359924acdf4619cfc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b24d4afc5104b359924acdf4619cfc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3b24d4afc5104b359924acdf4619cfc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b24d4afc5104b359924acdf4619cfc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:44:46.172484 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant: tempest-VolumesSnapshotTestJSON-1763949199 Oct 19 00:44:46.172484 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Id: 3b24d4afc5104b359924acdf4619cfc7 Oct 19 00:44:46.172484 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1763949199 Oct 19 00:44:46.172484 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User: tempest-VolumesSnapshotTestJSON-1763949199-project Oct 19 00:44:46.172484 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Id: default Oct 19 00:44:46.172484 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Name: Default Oct 19 00:44:46.172484 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Id: bb1e83f51a384b7d9d044bce87f00990 Oct 19 00:44:46.172484 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Name: tempest-VolumesSnapshotTestJSON-1763949199-project Oct 19 00:44:46.172484 dv-cinder-master-3-smb devstack@n-api.service[125532]: method: > Oct 19 00:44:46.172484 dv-cinder-master-3-smb devstack@n-api.service[125532]: exception: Instance 669ba27e-389e-4b04-959f-322c738a17df could not be found. Oct 19 00:44:46.172484 dv-cinder-master-3-smb devstack@n-api.service[125532]: action_args: {'id': '669ba27e-389e-4b04-959f-322c738a17df'} Oct 19 00:44:46.173273 dv-cinder-master-3-smb devstack@n-api.service[125532]: {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:46.173273 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:46.173273 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:44:46.173273 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:44:46.173273 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:44:46.173273 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:44:46.173273 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:44:46.173273 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:44:46.173273 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:44:46.173273 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:44:46.173273 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 669ba27e-389e-4b04-959f-322c738a17df could not be found. Oct 19 00:44:46.173273 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:44:46.173273 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:46.173273 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:44:46.173273 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:46.173273 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:46.173273 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:46.173273 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:46.173273 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:46.173273 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:46.174595 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:46.174595 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:44:46.174595 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:44:46.174595 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:44:46.174595 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:44:46.174595 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:44:46.174595 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:44:46.174595 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 669ba27e-389e-4b04-959f-322c738a17df could not be found. Oct 19 00:44:46.174595 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:44:46.174595 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:46.174595 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:44:46.174595 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:46.174595 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:46.174595 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:46.174595 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:44:46.174595 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:44:46.174595 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 669ba27e-389e-4b04-959f-322c738a17df could not be found. Oct 19 00:44:46.174595 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:44:46.175772 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-eaa79815-ddb7-4d78-846a-48970301aa63 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] Returning 404 to user: Instance 669ba27e-389e-4b04-959f-322c738a17df could not be found. {{(pid=125532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:46.175772 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-eaa79815-ddb7-4d78-846a-48970301aa63 tempest-VolumesSnapshotTestJSON-1763949199 tempest-VolumesSnapshotTestJSON-1763949199-project] 10.222.0.33 "GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df" status: 404 len: 111 microversion: 2.1 time: 0.031944 Oct 19 00:44:46.175772 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 353/684] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:46 2022] GET /compute/v2.1/servers/669ba27e-389e-4b04-959f-322c738a17df => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:44:47.523366 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-a9555119-53f2-4d03-9908-72b77eebaf20 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:47.524133 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-a9555119-53f2-4d03-9908-72b77eebaf20 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:47.530492 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a9555119-53f2-4d03-9908-72b77eebaf20 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:47.530961 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a9555119-53f2-4d03-9908-72b77eebaf20 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:47.531387 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a9555119-53f2-4d03-9908-72b77eebaf20 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:47.532213 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a9555119-53f2-4d03-9908-72b77eebaf20 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:47.532545 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a9555119-53f2-4d03-9908-72b77eebaf20 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:47.532962 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a9555119-53f2-4d03-9908-72b77eebaf20 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:47.557750 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-a9555119-53f2-4d03-9908-72b77eebaf20 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7/ips" status: 200 len: 149 microversion: 2.1 time: 0.038996 Oct 19 00:44:47.558322 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 332/685] 10.222.0.33 () {58 vars in 1248 bytes} [Wed Oct 19 00:44:47 2022] GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:47.572469 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-b6d55fb3-30fd-43d1-bd17-3e5f373dd067 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b6f31ef-f34a-485e-833c-6f3371a1800b"}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:47.575080 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-b6d55fb3-30fd-43d1-bd17-3e5f373dd067 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:47.581936 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b6d55fb3-30fd-43d1-bd17-3e5f373dd067 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:47.582452 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b6d55fb3-30fd-43d1-bd17-3e5f373dd067 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:47.582886 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b6d55fb3-30fd-43d1-bd17-3e5f373dd067 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:47.583581 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b6d55fb3-30fd-43d1-bd17-3e5f373dd067 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:47.584229 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b6d55fb3-30fd-43d1-bd17-3e5f373dd067 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:47.584724 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b6d55fb3-30fd-43d1-bd17-3e5f373dd067 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:47.626349 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-4c905688-d6cf-41fb-ba64-66bf25812933 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:47.627610 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-4c905688-d6cf-41fb-ba64-66bf25812933 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:47.634764 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4c905688-d6cf-41fb-ba64-66bf25812933 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:47.635253 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4c905688-d6cf-41fb-ba64-66bf25812933 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:47.635689 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4c905688-d6cf-41fb-ba64-66bf25812933 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:47.636433 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4c905688-d6cf-41fb-ba64-66bf25812933 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:47.636893 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4c905688-d6cf-41fb-ba64-66bf25812933 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:47.637323 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4c905688-d6cf-41fb-ba64-66bf25812933 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:47.641113 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=1 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:47.688479 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.wsgi [None req-b6d55fb3-30fd-43d1-bd17-3e5f373dd067 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] HTTP exception thrown: Invalid volume: volume 3b6f31ef-f34a-485e-833c-6f3371a1800b is already attached to instances: 361dfd3b-f488-4dac-9511-f28c93f74d37 Oct 19 00:44:47.690116 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-b6d55fb3-30fd-43d1-bd17-3e5f373dd067 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Request method failure captured: Oct 19 00:44:47.690116 dv-cinder-master-3-smb devstack@n-api.service[125532]: request: POST /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7/os-volume_attachments HTTP/1.1 Oct 19 00:44:47.690116 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept: application/json Oct 19 00:44:47.690116 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept-Encoding: identity Oct 19 00:44:47.690116 dv-cinder-master-3-smb devstack@n-api.service[125532]: Connection: close Oct 19 00:44:47.690116 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Length: 74 Oct 19 00:44:47.690116 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Type: application/json Oct 19 00:44:47.690116 dv-cinder-master-3-smb devstack@n-api.service[125532]: Host: 10.222.0.33 Oct 19 00:44:47.690116 dv-cinder-master-3-smb devstack@n-api.service[125532]: Openstack-System-Scope: None Oct 19 00:44:47.690116 dv-cinder-master-3-smb devstack@n-api.service[125532]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:47.690116 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Auth-Token: gAAAAABjT0dZO9Cl1BpR1E_5nrd-9g_6W01GCmRr-bxs2oosEmvGRcrx0Y-G0IKovE-TfQsuTKO_S4_zWYg0zNU477VxKqXUVmnxsIfPQLMl-kk4S2RGLMvzztHdGHZY35kfzLdr41wbpFPN7pnfATDs8WY4-rnm9WtQvzLBNibrb2MPfqFKqcA Oct 19 00:44:47.690116 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Id: None Oct 19 00:44:47.690116 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Name: None Oct 19 00:44:47.690116 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Identity-Status: Confirmed Oct 19 00:44:47.690116 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Is-Admin-Project: True Oct 19 00:44:47.690116 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Id: default Oct 19 00:44:47.690116 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Name: Default Oct 19 00:44:47.690116 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Id: 4081d4f735b04367a67a03b9539f5432 Oct 19 00:44:47.690116 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Name: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:44:47.690116 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Role: member,reader Oct 19 00:44:47.690116 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Roles: member,reader Oct 19 00:44:47.692306 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4081d4f735b04367a67a03b9539f5432"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:44:47.692306 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:44:47.692306 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Id: 4081d4f735b04367a67a03b9539f5432 Oct 19 00:44:47.692306 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:44:47.692306 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User: tempest-AttachVolumeNegativeTest-339799867-project Oct 19 00:44:47.692306 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Id: default Oct 19 00:44:47.692306 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Name: Default Oct 19 00:44:47.692306 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Id: 5f9a55c605f04f478d0a71679d8bf6a1 Oct 19 00:44:47.692306 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Name: tempest-AttachVolumeNegativeTest-339799867-project Oct 19 00:44:47.692306 dv-cinder-master-3-smb devstack@n-api.service[125532]: Oct 19 00:44:47.692306 dv-cinder-master-3-smb devstack@n-api.service[125532]: {"volumeAttachment": {"volumeId": "3b6f31ef-f34a-485e-833c-6f3371a1800b"}} Oct 19 00:44:47.692306 dv-cinder-master-3-smb devstack@n-api.service[125532]: method: > Oct 19 00:44:47.693087 dv-cinder-master-3-smb devstack@n-api.service[125532]: exception: Invalid volume: volume 3b6f31ef-f34a-485e-833c-6f3371a1800b is already attached to instances: 361dfd3b-f488-4dac-9511-f28c93f74d37 Oct 19 00:44:47.693087 dv-cinder-master-3-smb devstack@n-api.service[125532]: action_args: {'server_id': '21c2af83-cdf5-43fb-b75e-287be2eb0db7', 'body': {'volumeAttachment': {'volumeId': '3b6f31ef-f34a-485e-833c-6f3371a1800b'}}} Oct 19 00:44:47.693087 dv-cinder-master-3-smb devstack@n-api.service[125532]: {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:47.693087 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:47.693087 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 19 00:44:47.693087 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 19 00:44:47.693087 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 00:44:47.693087 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 00:44:47.693087 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 19 00:44:47.693087 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 00:44:47.693087 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 19 00:44:47.693087 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 19 00:44:47.693087 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 19 00:44:47.693087 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 19 00:44:47.693087 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3b6f31ef-f34a-485e-833c-6f3371a1800b is already attached to instances: 361dfd3b-f488-4dac-9511-f28c93f74d37 Oct 19 00:44:47.693087 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:44:47.693087 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:47.693087 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:44:47.693087 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:47.694255 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:47.694255 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:47.694255 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:47.694255 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:47.694255 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:47.694255 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:47.694255 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:44:47.694255 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:44:47.694255 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:44:47.694255 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:44:47.694255 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:44:47.694255 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:44:47.694255 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 19 00:44:47.694255 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 19 00:44:47.694255 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3b6f31ef-f34a-485e-833c-6f3371a1800b is already attached to instances: 361dfd3b-f488-4dac-9511-f28c93f74d37 Oct 19 00:44:47.694255 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:44:47.694255 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:47.694255 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:44:47.694255 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:47.694255 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:47.695453 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:47.695453 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:44:47.695453 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:44:47.695453 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3b6f31ef-f34a-485e-833c-6f3371a1800b is already attached to instances: 361dfd3b-f488-4dac-9511-f28c93f74d37 Oct 19 00:44:47.695453 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:44:47.695453 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-b6d55fb3-30fd-43d1-bd17-3e5f373dd067 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Returning 400 to user: Invalid volume: volume 3b6f31ef-f34a-485e-833c-6f3371a1800b is already attached to instances: 361dfd3b-f488-4dac-9511-f28c93f74d37 {{(pid=125532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:47.695453 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-b6d55fb3-30fd-43d1-bd17-3e5f373dd067 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "POST /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.123607 Oct 19 00:44:47.695453 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 354/686] 10.222.0.33 () {60 vars in 1323 bytes} [Wed Oct 19 00:44:47 2022] POST /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7/os-volume_attachments => generated 174 bytes in 126 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:44:47.702327 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-0b707c99-1233-4b8d-834a-ae6db60631c3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:47.702962 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-0b707c99-1233-4b8d-834a-ae6db60631c3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:47.709720 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0b707c99-1233-4b8d-834a-ae6db60631c3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:47.710275 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0b707c99-1233-4b8d-834a-ae6db60631c3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:47.710779 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0b707c99-1233-4b8d-834a-ae6db60631c3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:47.711546 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0b707c99-1233-4b8d-834a-ae6db60631c3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:47.712173 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0b707c99-1233-4b8d-834a-ae6db60631c3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:47.713074 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0b707c99-1233-4b8d-834a-ae6db60631c3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:47.732481 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.objects.instance [None req-4c905688-d6cf-41fb-ba64-66bf25812933 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lazy-loading 'services' on Instance uuid f550e071-b7cd-4628-aff9-59e09cfcd654 {{(pid=125531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:44:47.743518 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-0b707c99-1233-4b8d-834a-ae6db60631c3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Going to try to terminate instance {{(pid=125532) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:44:47.807118 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-4c905688-d6cf-41fb-ba64-66bf25812933 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654/os-volume_attachments/d9629836-fa7b-46c1-99b9-165b78ecc003" status: 202 len: 0 microversion: 2.1 time: 0.187099 Oct 19 00:44:47.807917 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 333/687] 10.222.0.33 () {58 vars in 1416 bytes} [Wed Oct 19 00:44:47 2022] DELETE /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654/os-volume_attachments/d9629836-fa7b-46c1-99b9-165b78ecc003 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:44:47.827177 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-0b707c99-1233-4b8d-834a-ae6db60631c3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "DELETE /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7" status: 204 len: 0 microversion: 2.1 time: 0.128221 Oct 19 00:44:47.830742 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 355/688] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Oct 19 00:44:47 2022] DELETE /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 00:44:47.839486 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-ca7dd0d7-d85b-46fa-9ea1-481e08b3ae56 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:47.840789 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-ca7dd0d7-d85b-46fa-9ea1-481e08b3ae56 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:47.876110 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ca7dd0d7-d85b-46fa-9ea1-481e08b3ae56 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:47.876110 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ca7dd0d7-d85b-46fa-9ea1-481e08b3ae56 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:47.876110 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ca7dd0d7-d85b-46fa-9ea1-481e08b3ae56 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:47.876110 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ca7dd0d7-d85b-46fa-9ea1-481e08b3ae56 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:47.876482 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ca7dd0d7-d85b-46fa-9ea1-481e08b3ae56 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:47.876482 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ca7dd0d7-d85b-46fa-9ea1-481e08b3ae56 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:48.002504 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-ca7dd0d7-d85b-46fa-9ea1-481e08b3ae56 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:48.011255 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-ca7dd0d7-d85b-46fa-9ea1-481e08b3ae56 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7" status: 200 len: 1681 microversion: 2.1 time: 0.178367 Oct 19 00:44:48.011821 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 334/689] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:47 2022] GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:49.037238 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-f554072f-d3fd-41e6-b43f-1badf5f1462b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:49.037238 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-f554072f-d3fd-41e6-b43f-1badf5f1462b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:49.041683 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f554072f-d3fd-41e6-b43f-1badf5f1462b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:49.042167 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f554072f-d3fd-41e6-b43f-1badf5f1462b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:49.042777 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f554072f-d3fd-41e6-b43f-1badf5f1462b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:49.043605 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f554072f-d3fd-41e6-b43f-1badf5f1462b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:49.043995 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f554072f-d3fd-41e6-b43f-1badf5f1462b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:49.044370 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f554072f-d3fd-41e6-b43f-1badf5f1462b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:49.180763 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-f554072f-d3fd-41e6-b43f-1badf5f1462b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:49.188491 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-f554072f-d3fd-41e6-b43f-1badf5f1462b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7" status: 200 len: 1681 microversion: 2.1 time: 0.158600 Oct 19 00:44:49.189055 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 356/690] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:49 2022] GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:44:50.212234 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-c2a43f46-2d23-43c5-b361-425d97399f8b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:50.212773 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-c2a43f46-2d23-43c5-b361-425d97399f8b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:50.219250 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c2a43f46-2d23-43c5-b361-425d97399f8b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:50.219726 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c2a43f46-2d23-43c5-b361-425d97399f8b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:50.220240 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c2a43f46-2d23-43c5-b361-425d97399f8b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:50.220928 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c2a43f46-2d23-43c5-b361-425d97399f8b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:50.221375 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c2a43f46-2d23-43c5-b361-425d97399f8b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:50.221794 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c2a43f46-2d23-43c5-b361-425d97399f8b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:50.360348 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-c2a43f46-2d23-43c5-b361-425d97399f8b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:50.370718 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-c2a43f46-2d23-43c5-b361-425d97399f8b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7" status: 200 len: 1681 microversion: 2.1 time: 0.162472 Oct 19 00:44:50.371873 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 335/691] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:50 2022] GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:51.063743 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-66487041-fde6-4a56-8d2a-a80718b5d3ca tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:51.072172 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-66487041-fde6-4a56-8d2a-a80718b5d3ca tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:51.073454 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-66487041-fde6-4a56-8d2a-a80718b5d3ca tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:51.076290 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-66487041-fde6-4a56-8d2a-a80718b5d3ca tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:51.152400 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-66487041-fde6-4a56-8d2a-a80718b5d3ca tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Going to try to stop instance {{(pid=125532) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 19 00:44:51.185869 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-4b1ac21f-6aaa-47b5-ba05-1eee04277159 req-be69fb0a-7cb2-4e17-a237-5ad03d3e58fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21c2af83-cdf5-43fb-b75e-287be2eb0db7", "name": "network-vif-deleted", "tag": "c6820303-74cd-4f71-8696-e193e257c7cb"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:51.195925 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 00:44:51.198390 dv-cinder-master-3-smb devstack@n-api.service[125531]: Wed Oct 19 00:44:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.33) !!! Oct 19 00:44:51.220611 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-66487041-fde6-4a56-8d2a-a80718b5d3ca tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "POST /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654/action" status: 202 len: 0 microversion: 2.1 time: 0.160525 Oct 19 00:44:51.226162 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 357/692] 10.222.0.33 () {60 vars in 1278 bytes} [Wed Oct 19 00:44:51 2022] POST /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:44:51.229051 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-4b1ac21f-6aaa-47b5-ba05-1eee04277159 req-be69fb0a-7cb2-4e17-a237-5ad03d3e58fc service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:51.230154 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-4b1ac21f-6aaa-47b5-ba05-1eee04277159 req-be69fb0a-7cb2-4e17-a237-5ad03d3e58fc service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:51.230793 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-4b1ac21f-6aaa-47b5-ba05-1eee04277159 req-be69fb0a-7cb2-4e17-a237-5ad03d3e58fc service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:51.238087 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-33b0c8bc-d1d7-484b-a52e-4a6538ede127 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:51.240048 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-33b0c8bc-d1d7-484b-a52e-4a6538ede127 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:51.253292 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-4b1ac21f-6aaa-47b5-ba05-1eee04277159 req-be69fb0a-7cb2-4e17-a237-5ad03d3e58fc service nova] Creating event network-vif-deleted:c6820303-74cd-4f71-8696-e193e257c7cb for instance 21c2af83-cdf5-43fb-b75e-287be2eb0db7 on hv-cinder-maste Oct 19 00:44:51.260281 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-33b0c8bc-d1d7-484b-a52e-4a6538ede127 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:51.262834 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-33b0c8bc-d1d7-484b-a52e-4a6538ede127 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:51.263425 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-33b0c8bc-d1d7-484b-a52e-4a6538ede127 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:51.267101 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-4b1ac21f-6aaa-47b5-ba05-1eee04277159 req-be69fb0a-7cb2-4e17-a237-5ad03d3e58fc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084873 Oct 19 00:44:51.267889 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 336/693] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:44:51.271960 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-33b0c8bc-d1d7-484b-a52e-4a6538ede127 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:51.272619 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-33b0c8bc-d1d7-484b-a52e-4a6538ede127 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:51.273231 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-33b0c8bc-d1d7-484b-a52e-4a6538ede127 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:51.398066 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-db5d6f94-e2b5-4634-becc-cefbf8d25617 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:51.399651 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-db5d6f94-e2b5-4634-becc-cefbf8d25617 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:51.411719 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-db5d6f94-e2b5-4634-becc-cefbf8d25617 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:51.413467 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-db5d6f94-e2b5-4634-becc-cefbf8d25617 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:51.414042 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-db5d6f94-e2b5-4634-becc-cefbf8d25617 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:51.414973 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-db5d6f94-e2b5-4634-becc-cefbf8d25617 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:51.415648 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-db5d6f94-e2b5-4634-becc-cefbf8d25617 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:51.416640 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-db5d6f94-e2b5-4634-becc-cefbf8d25617 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:51.436445 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-33b0c8bc-d1d7-484b-a52e-4a6538ede127 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:51.449168 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-33b0c8bc-d1d7-484b-a52e-4a6538ede127 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1679 microversion: 2.1 time: 0.217402 Oct 19 00:44:51.455895 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 358/694] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:51 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1679 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:44:51.459238 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-db5d6f94-e2b5-4634-becc-cefbf8d25617 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:51.459693 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-db5d6f94-e2b5-4634-becc-cefbf8d25617 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:51.460154 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-db5d6f94-e2b5-4634-becc-cefbf8d25617 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:51.460614 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.objects.instance [None req-db5d6f94-e2b5-4634-becc-cefbf8d25617 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lazy-loading 'fault' on Instance uuid 21c2af83-cdf5-43fb-b75e-287be2eb0db7 {{(pid=125531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:44:51.506910 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-db5d6f94-e2b5-4634-becc-cefbf8d25617 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:51.514849 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-db5d6f94-e2b5-4634-becc-cefbf8d25617 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7" status: 200 len: 1331 microversion: 2.1 time: 0.123999 Oct 19 00:44:51.515833 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 337/695] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:51 2022] GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 => generated 1331 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:44:52.473977 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-f76ae1a1-52f2-43b6-8686-dc754e32116f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:52.474588 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-f76ae1a1-52f2-43b6-8686-dc754e32116f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:52.486806 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f76ae1a1-52f2-43b6-8686-dc754e32116f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:52.487385 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f76ae1a1-52f2-43b6-8686-dc754e32116f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:52.487979 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f76ae1a1-52f2-43b6-8686-dc754e32116f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:52.489835 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f76ae1a1-52f2-43b6-8686-dc754e32116f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:52.490778 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f76ae1a1-52f2-43b6-8686-dc754e32116f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:52.491267 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f76ae1a1-52f2-43b6-8686-dc754e32116f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:52.540997 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-8d332847-d2d4-4121-8c83-2e55f371cee2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:52.541610 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-8d332847-d2d4-4121-8c83-2e55f371cee2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:52.553189 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8d332847-d2d4-4121-8c83-2e55f371cee2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:52.554493 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8d332847-d2d4-4121-8c83-2e55f371cee2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:52.555625 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8d332847-d2d4-4121-8c83-2e55f371cee2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:52.557522 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8d332847-d2d4-4121-8c83-2e55f371cee2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:52.558456 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8d332847-d2d4-4121-8c83-2e55f371cee2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:52.558959 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8d332847-d2d4-4121-8c83-2e55f371cee2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:52.578355 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.wsgi [None req-8d332847-d2d4-4121-8c83-2e55f371cee2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] HTTP exception thrown: Instance 21c2af83-cdf5-43fb-b75e-287be2eb0db7 could not be found. Oct 19 00:44:52.580942 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-8d332847-d2d4-4121-8c83-2e55f371cee2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Request method failure captured: Oct 19 00:44:52.580942 dv-cinder-master-3-smb devstack@n-api.service[125531]: request: GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 HTTP/1.1 Oct 19 00:44:52.580942 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept: application/json Oct 19 00:44:52.580942 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept-Encoding: identity Oct 19 00:44:52.580942 dv-cinder-master-3-smb devstack@n-api.service[125531]: Connection: close Oct 19 00:44:52.580942 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Length: 0 Oct 19 00:44:52.580942 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Type: application/json Oct 19 00:44:52.580942 dv-cinder-master-3-smb devstack@n-api.service[125531]: Host: 10.222.0.33 Oct 19 00:44:52.580942 dv-cinder-master-3-smb devstack@n-api.service[125531]: Openstack-System-Scope: None Oct 19 00:44:52.580942 dv-cinder-master-3-smb devstack@n-api.service[125531]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:52.580942 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Auth-Token: gAAAAABjT0dZO9Cl1BpR1E_5nrd-9g_6W01GCmRr-bxs2oosEmvGRcrx0Y-G0IKovE-TfQsuTKO_S4_zWYg0zNU477VxKqXUVmnxsIfPQLMl-kk4S2RGLMvzztHdGHZY35kfzLdr41wbpFPN7pnfATDs8WY4-rnm9WtQvzLBNibrb2MPfqFKqcA Oct 19 00:44:52.580942 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Id: None Oct 19 00:44:52.580942 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Name: None Oct 19 00:44:52.580942 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Identity-Status: Confirmed Oct 19 00:44:52.580942 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Is-Admin-Project: True Oct 19 00:44:52.580942 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Id: default Oct 19 00:44:52.580942 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Name: Default Oct 19 00:44:52.580942 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Id: 4081d4f735b04367a67a03b9539f5432 Oct 19 00:44:52.580942 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Name: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:44:52.580942 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Role: member,reader Oct 19 00:44:52.580942 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Roles: member,reader Oct 19 00:44:52.582234 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4081d4f735b04367a67a03b9539f5432"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:44:52.582234 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:44:52.582234 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Id: 4081d4f735b04367a67a03b9539f5432 Oct 19 00:44:52.582234 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:44:52.582234 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User: tempest-AttachVolumeNegativeTest-339799867-project Oct 19 00:44:52.582234 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Id: default Oct 19 00:44:52.582234 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Name: Default Oct 19 00:44:52.582234 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Id: 5f9a55c605f04f478d0a71679d8bf6a1 Oct 19 00:44:52.582234 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Name: tempest-AttachVolumeNegativeTest-339799867-project Oct 19 00:44:52.582234 dv-cinder-master-3-smb devstack@n-api.service[125531]: method: > Oct 19 00:44:52.582234 dv-cinder-master-3-smb devstack@n-api.service[125531]: exception: Instance 21c2af83-cdf5-43fb-b75e-287be2eb0db7 could not be found. Oct 19 00:44:52.582234 dv-cinder-master-3-smb devstack@n-api.service[125531]: action_args: {'id': '21c2af83-cdf5-43fb-b75e-287be2eb0db7'} Oct 19 00:44:52.583109 dv-cinder-master-3-smb devstack@n-api.service[125531]: {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:52.583109 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:52.583109 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:44:52.583109 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:44:52.583109 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:44:52.583109 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:44:52.583109 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:44:52.583109 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:44:52.583109 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:44:52.583109 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:44:52.583109 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21c2af83-cdf5-43fb-b75e-287be2eb0db7 could not be found. Oct 19 00:44:52.583109 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:44:52.583109 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:52.583109 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:44:52.583109 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:52.583109 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:52.583109 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:52.583109 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:52.583109 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:52.583109 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:52.584408 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:52.584408 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:44:52.584408 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:44:52.584408 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:44:52.584408 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:44:52.584408 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:44:52.584408 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:44:52.584408 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21c2af83-cdf5-43fb-b75e-287be2eb0db7 could not be found. Oct 19 00:44:52.584408 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:44:52.584408 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:52.584408 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:44:52.584408 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:52.584408 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:52.584408 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:52.584408 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:44:52.584408 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:44:52.584408 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21c2af83-cdf5-43fb-b75e-287be2eb0db7 could not be found. Oct 19 00:44:52.584408 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:44:52.586905 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-8d332847-d2d4-4121-8c83-2e55f371cee2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Returning 404 to user: Instance 21c2af83-cdf5-43fb-b75e-287be2eb0db7 could not be found. {{(pid=125531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:52.588346 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-8d332847-d2d4-4121-8c83-2e55f371cee2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7" status: 404 len: 111 microversion: 2.1 time: 0.053548 Oct 19 00:44:52.589467 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 338/696] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:52 2022] GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 00:44:52.600845 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-46628cec-c41c-409c-9cdd-bce5d598f51b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '.version_select at 0x7f81f0e2f310>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:52.638801 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-46628cec-c41c-409c-9cdd-bce5d598f51b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2106051418" status: 202 len: 0 microversion: 2.1 time: 0.043094 Oct 19 00:44:52.639597 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 339/697] 10.222.0.33 () {58 vars in 1221 bytes} [Wed Oct 19 00:44:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2106051418 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:44:52.656878 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-f76ae1a1-52f2-43b6-8686-dc754e32116f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:52.665336 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-f76ae1a1-52f2-43b6-8686-dc754e32116f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1679 microversion: 2.1 time: 0.196042 Oct 19 00:44:52.666256 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 359/698] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:52 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1679 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:53.358460 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-5b57735d-80df-4fe5-a4d7-8275e7f9d55f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:53.359249 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-5b57735d-80df-4fe5-a4d7-8275e7f9d55f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 361dfd3b-f488-4dac-9511-f28c93f74d37] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:53.366886 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5b57735d-80df-4fe5-a4d7-8275e7f9d55f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:53.367460 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5b57735d-80df-4fe5-a4d7-8275e7f9d55f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:53.368003 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5b57735d-80df-4fe5-a4d7-8275e7f9d55f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:53.368700 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5b57735d-80df-4fe5-a4d7-8275e7f9d55f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:53.369156 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5b57735d-80df-4fe5-a4d7-8275e7f9d55f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:53.369582 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5b57735d-80df-4fe5-a4d7-8275e7f9d55f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:53.449232 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.objects.instance [None req-5b57735d-80df-4fe5-a4d7-8275e7f9d55f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lazy-loading 'services' on Instance uuid 361dfd3b-f488-4dac-9511-f28c93f74d37 {{(pid=125531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:44:53.522610 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-5b57735d-80df-4fe5-a4d7-8275e7f9d55f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "DELETE /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37/os-volume_attachments/3b6f31ef-f34a-485e-833c-6f3371a1800b" status: 202 len: 0 microversion: 2.1 time: 0.167964 Oct 19 00:44:53.523216 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 340/699] 10.222.0.33 () {58 vars in 1416 bytes} [Wed Oct 19 00:44:53 2022] DELETE /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37/os-volume_attachments/3b6f31ef-f34a-485e-833c-6f3371a1800b => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:44:53.531599 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-b1923cfa-208a-417b-8d47-0b67edc7959f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:53.533927 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-b1923cfa-208a-417b-8d47-0b67edc7959f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 361dfd3b-f488-4dac-9511-f28c93f74d37] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:53.541733 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b1923cfa-208a-417b-8d47-0b67edc7959f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:53.542239 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b1923cfa-208a-417b-8d47-0b67edc7959f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:53.542674 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b1923cfa-208a-417b-8d47-0b67edc7959f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:53.543372 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b1923cfa-208a-417b-8d47-0b67edc7959f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:53.543825 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b1923cfa-208a-417b-8d47-0b67edc7959f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:53.544286 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b1923cfa-208a-417b-8d47-0b67edc7959f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:53.546920 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:53.578685 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-b1923cfa-208a-417b-8d47-0b67edc7959f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050959 Oct 19 00:44:53.579246 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 360/700] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Oct 19 00:44:53 2022] GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:53.692987 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-8454da4e-42ae-490e-a1c2-8b4e2fcea076 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:53.693730 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-8454da4e-42ae-490e-a1c2-8b4e2fcea076 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:53.699962 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8454da4e-42ae-490e-a1c2-8b4e2fcea076 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:53.700392 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8454da4e-42ae-490e-a1c2-8b4e2fcea076 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:53.700821 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8454da4e-42ae-490e-a1c2-8b4e2fcea076 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:53.701508 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8454da4e-42ae-490e-a1c2-8b4e2fcea076 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:53.701960 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8454da4e-42ae-490e-a1c2-8b4e2fcea076 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:53.702384 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8454da4e-42ae-490e-a1c2-8b4e2fcea076 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:53.838444 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-8454da4e-42ae-490e-a1c2-8b4e2fcea076 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:53.847184 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-8454da4e-42ae-490e-a1c2-8b4e2fcea076 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1679 microversion: 2.1 time: 0.159185 Oct 19 00:44:53.862739 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 341/701] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:53 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:54.640991 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-18e58b2f-35ba-4325-ad8e-897a5a6a4491 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:54.643174 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-18e58b2f-35ba-4325-ad8e-897a5a6a4491 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 361dfd3b-f488-4dac-9511-f28c93f74d37] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:54.649396 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-18e58b2f-35ba-4325-ad8e-897a5a6a4491 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:54.649878 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-18e58b2f-35ba-4325-ad8e-897a5a6a4491 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:54.650318 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-18e58b2f-35ba-4325-ad8e-897a5a6a4491 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:54.651011 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-18e58b2f-35ba-4325-ad8e-897a5a6a4491 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:54.651463 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-18e58b2f-35ba-4325-ad8e-897a5a6a4491 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:54.651911 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-18e58b2f-35ba-4325-ad8e-897a5a6a4491 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:54.682863 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-18e58b2f-35ba-4325-ad8e-897a5a6a4491 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094864 Oct 19 00:44:54.683666 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 361/702] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Oct 19 00:44:54 2022] GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:54.870830 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-2c48b25f-dfba-4968-b1bf-a2ac62ec5e52 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:54.871435 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-2c48b25f-dfba-4968-b1bf-a2ac62ec5e52 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:54.878181 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2c48b25f-dfba-4968-b1bf-a2ac62ec5e52 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:54.878668 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2c48b25f-dfba-4968-b1bf-a2ac62ec5e52 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:54.879216 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2c48b25f-dfba-4968-b1bf-a2ac62ec5e52 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:54.879949 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2c48b25f-dfba-4968-b1bf-a2ac62ec5e52 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:54.880409 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2c48b25f-dfba-4968-b1bf-a2ac62ec5e52 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:54.880832 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2c48b25f-dfba-4968-b1bf-a2ac62ec5e52 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:55.110436 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-2c48b25f-dfba-4968-b1bf-a2ac62ec5e52 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:55.119006 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-2c48b25f-dfba-4968-b1bf-a2ac62ec5e52 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1679 microversion: 2.1 time: 0.252000 Oct 19 00:44:55.119576 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 342/703] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:54 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1679 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:55.696127 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-9d6cc4d4-bb0a-4910-830f-ed7c604f59e5 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:55.698238 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-9d6cc4d4-bb0a-4910-830f-ed7c604f59e5 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 361dfd3b-f488-4dac-9511-f28c93f74d37] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:55.704617 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9d6cc4d4-bb0a-4910-830f-ed7c604f59e5 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:55.705091 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9d6cc4d4-bb0a-4910-830f-ed7c604f59e5 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:55.705521 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9d6cc4d4-bb0a-4910-830f-ed7c604f59e5 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:55.706205 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9d6cc4d4-bb0a-4910-830f-ed7c604f59e5 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:55.706656 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9d6cc4d4-bb0a-4910-830f-ed7c604f59e5 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:55.707932 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9d6cc4d4-bb0a-4910-830f-ed7c604f59e5 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:55.736845 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-9d6cc4d4-bb0a-4910-830f-ed7c604f59e5 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044703 Oct 19 00:44:55.737393 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 362/704] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Oct 19 00:44:55 2022] GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:44:55.801400 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-5cdb4eea-0e29-4c63-8902-0c10f0d14640 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:55.801894 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-5cdb4eea-0e29-4c63-8902-0c10f0d14640 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 361dfd3b-f488-4dac-9511-f28c93f74d37] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:55.807768 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5cdb4eea-0e29-4c63-8902-0c10f0d14640 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:55.808279 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5cdb4eea-0e29-4c63-8902-0c10f0d14640 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:55.808713 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5cdb4eea-0e29-4c63-8902-0c10f0d14640 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:55.809388 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5cdb4eea-0e29-4c63-8902-0c10f0d14640 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:55.809831 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5cdb4eea-0e29-4c63-8902-0c10f0d14640 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:55.810249 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5cdb4eea-0e29-4c63-8902-0c10f0d14640 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:55.834813 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-5cdb4eea-0e29-4c63-8902-0c10f0d14640 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 361dfd3b-f488-4dac-9511-f28c93f74d37] Going to try to terminate instance {{(pid=125531) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:44:55.912346 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-5cdb4eea-0e29-4c63-8902-0c10f0d14640 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "DELETE /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37" status: 204 len: 0 microversion: 2.1 time: 0.114317 Oct 19 00:44:55.913068 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 343/705] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Oct 19 00:44:55 2022] DELETE /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:44:55.921329 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-e42609e4-8d80-43f3-bc62-454d9d287903 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:55.921936 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-e42609e4-8d80-43f3-bc62-454d9d287903 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 361dfd3b-f488-4dac-9511-f28c93f74d37] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:55.927992 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e42609e4-8d80-43f3-bc62-454d9d287903 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:55.928470 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e42609e4-8d80-43f3-bc62-454d9d287903 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:55.928898 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e42609e4-8d80-43f3-bc62-454d9d287903 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:55.929579 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e42609e4-8d80-43f3-bc62-454d9d287903 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:55.930031 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e42609e4-8d80-43f3-bc62-454d9d287903 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:55.930453 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e42609e4-8d80-43f3-bc62-454d9d287903 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:56.056219 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-e42609e4-8d80-43f3-bc62-454d9d287903 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:56.063825 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-e42609e4-8d80-43f3-bc62-454d9d287903 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37" status: 200 len: 1679 microversion: 2.1 time: 0.146275 Oct 19 00:44:56.064397 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 363/706] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:55 2022] GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37 => generated 1679 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:56.142404 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-8958ea7e-e43a-4ae2-82bf-1e726412e2f2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:56.143096 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-8958ea7e-e43a-4ae2-82bf-1e726412e2f2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:56.149749 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8958ea7e-e43a-4ae2-82bf-1e726412e2f2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:56.150241 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8958ea7e-e43a-4ae2-82bf-1e726412e2f2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:56.150682 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8958ea7e-e43a-4ae2-82bf-1e726412e2f2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:56.151381 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8958ea7e-e43a-4ae2-82bf-1e726412e2f2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:56.151834 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8958ea7e-e43a-4ae2-82bf-1e726412e2f2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:56.152313 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8958ea7e-e43a-4ae2-82bf-1e726412e2f2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:56.280003 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-8958ea7e-e43a-4ae2-82bf-1e726412e2f2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:56.287724 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-8958ea7e-e43a-4ae2-82bf-1e726412e2f2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1679 microversion: 2.1 time: 0.149479 Oct 19 00:44:56.288311 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 344/707] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:56 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:57.087491 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-5b5739a7-ed4f-43dd-9404-48af7f46cb12 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:57.088188 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-5b5739a7-ed4f-43dd-9404-48af7f46cb12 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 361dfd3b-f488-4dac-9511-f28c93f74d37] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:57.090877 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 00:44:57.091023 dv-cinder-master-3-smb devstack@n-api.service[125532]: Wed Oct 19 00:44:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37 (ip 10.222.0.33) !!! Oct 19 00:44:57.098332 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5b5739a7-ed4f-43dd-9404-48af7f46cb12 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:57.098815 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5b5739a7-ed4f-43dd-9404-48af7f46cb12 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:57.099277 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5b5739a7-ed4f-43dd-9404-48af7f46cb12 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:57.100012 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5b5739a7-ed4f-43dd-9404-48af7f46cb12 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:57.100467 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5b5739a7-ed4f-43dd-9404-48af7f46cb12 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:57.100887 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5b5739a7-ed4f-43dd-9404-48af7f46cb12 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:57.227185 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-5b5739a7-ed4f-43dd-9404-48af7f46cb12 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:57.234790 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-5b5739a7-ed4f-43dd-9404-48af7f46cb12 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37" status: 200 len: 1679 microversion: 2.1 time: 0.151172 Oct 19 00:44:57.235352 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 364/708] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:57 2022] GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:57.310637 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-3d49d954-8816-4abe-9da0-e5f2ace1e9ab tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:57.311243 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-3d49d954-8816-4abe-9da0-e5f2ace1e9ab tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:57.318071 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3d49d954-8816-4abe-9da0-e5f2ace1e9ab tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:57.318547 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3d49d954-8816-4abe-9da0-e5f2ace1e9ab tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:57.318978 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3d49d954-8816-4abe-9da0-e5f2ace1e9ab tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:57.319971 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3d49d954-8816-4abe-9da0-e5f2ace1e9ab tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:57.320422 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3d49d954-8816-4abe-9da0-e5f2ace1e9ab tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:57.320844 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3d49d954-8816-4abe-9da0-e5f2ace1e9ab tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:57.455241 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-3d49d954-8816-4abe-9da0-e5f2ace1e9ab tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:57.463817 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-3d49d954-8816-4abe-9da0-e5f2ace1e9ab tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1679 microversion: 2.1 time: 0.157263 Oct 19 00:44:57.465189 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 345/709] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:57 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:58.258281 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-f220a747-faac-49c3-bb22-f4c7925c4d48 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:58.258912 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-f220a747-faac-49c3-bb22-f4c7925c4d48 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 361dfd3b-f488-4dac-9511-f28c93f74d37] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:58.265965 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f220a747-faac-49c3-bb22-f4c7925c4d48 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:58.266438 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f220a747-faac-49c3-bb22-f4c7925c4d48 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:58.266863 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f220a747-faac-49c3-bb22-f4c7925c4d48 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:58.267555 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f220a747-faac-49c3-bb22-f4c7925c4d48 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:58.268077 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f220a747-faac-49c3-bb22-f4c7925c4d48 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:58.268495 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f220a747-faac-49c3-bb22-f4c7925c4d48 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:58.486788 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-37605b5c-d731-4706-a863-b0d37804789b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:58.487315 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-37605b5c-d731-4706-a863-b0d37804789b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:58.494285 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-37605b5c-d731-4706-a863-b0d37804789b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:58.494759 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-37605b5c-d731-4706-a863-b0d37804789b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:58.495186 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-37605b5c-d731-4706-a863-b0d37804789b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:58.495901 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-37605b5c-d731-4706-a863-b0d37804789b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:58.496354 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-37605b5c-d731-4706-a863-b0d37804789b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:58.496770 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-37605b5c-d731-4706-a863-b0d37804789b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:58.633523 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-37605b5c-d731-4706-a863-b0d37804789b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:58.645286 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-37605b5c-d731-4706-a863-b0d37804789b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1679 microversion: 2.1 time: 0.161743 Oct 19 00:44:58.646012 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 346/710] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:58 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:44:58.734752 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-f220a747-faac-49c3-bb22-f4c7925c4d48 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:58.745126 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-f220a747-faac-49c3-bb22-f4c7925c4d48 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37" status: 200 len: 1679 microversion: 2.1 time: 0.490601 Oct 19 00:44:58.745798 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 365/711] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:58 2022] GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37 => generated 1679 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:59.048579 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-6fa2b029-a8c7-454d-9814-4a363262d722 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:59.051687 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-6fa2b029-a8c7-454d-9814-4a363262d722 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:59.057720 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6fa2b029-a8c7-454d-9814-4a363262d722 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:59.058260 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6fa2b029-a8c7-454d-9814-4a363262d722 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:59.058772 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6fa2b029-a8c7-454d-9814-4a363262d722 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:59.059478 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6fa2b029-a8c7-454d-9814-4a363262d722 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:59.059957 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6fa2b029-a8c7-454d-9814-4a363262d722 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:59.060386 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6fa2b029-a8c7-454d-9814-4a363262d722 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:59.123207 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:59.133871 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-6fa2b029-a8c7-454d-9814-4a363262d722 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "POST /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4/action" status: 202 len: 0 microversion: 2.1 time: 0.088806 Oct 19 00:44:59.137390 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 347/712] 10.222.0.33 () {60 vars in 1278 bytes} [Wed Oct 19 00:44:59 2022] POST /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:44:59.143457 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-b3816f26-f6b7-45f4-aed5-7b940e581674 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:59.144100 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-b3816f26-f6b7-45f4-aed5-7b940e581674 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:59.150847 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b3816f26-f6b7-45f4-aed5-7b940e581674 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:59.151439 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b3816f26-f6b7-45f4-aed5-7b940e581674 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:59.152189 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b3816f26-f6b7-45f4-aed5-7b940e581674 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:59.152901 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b3816f26-f6b7-45f4-aed5-7b940e581674 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:59.154075 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b3816f26-f6b7-45f4-aed5-7b940e581674 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:59.155074 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b3816f26-f6b7-45f4-aed5-7b940e581674 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:59.407014 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-70750cce-784c-493c-b99f-2106bca82168 req-7f08b0fd-770b-4471-830a-71c3ab8612a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "361dfd3b-f488-4dac-9511-f28c93f74d37", "name": "network-vif-deleted", "tag": "579ced1d-44c1-46ae-bffb-7e11769e3f01"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:59.423490 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-70750cce-784c-493c-b99f-2106bca82168 req-7f08b0fd-770b-4471-830a-71c3ab8612a4 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:59.424503 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-70750cce-784c-493c-b99f-2106bca82168 req-7f08b0fd-770b-4471-830a-71c3ab8612a4 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:59.430492 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-70750cce-784c-493c-b99f-2106bca82168 req-7f08b0fd-770b-4471-830a-71c3ab8612a4 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:59.453390 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-70750cce-784c-493c-b99f-2106bca82168 req-7f08b0fd-770b-4471-830a-71c3ab8612a4 service nova] Creating event network-vif-deleted:579ced1d-44c1-46ae-bffb-7e11769e3f01 for instance 361dfd3b-f488-4dac-9511-f28c93f74d37 on hv-cinder-maste Oct 19 00:44:59.459662 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-70750cce-784c-493c-b99f-2106bca82168 req-7f08b0fd-770b-4471-830a-71c3ab8612a4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058822 Oct 19 00:44:59.460971 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 348/713] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:44:59.495615 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-b3816f26-f6b7-45f4-aed5-7b940e581674 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:59.504444 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-b3816f26-f6b7-45f4-aed5-7b940e581674 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1751 microversion: 2.1 time: 0.365016 Oct 19 00:44:59.508092 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 366/714] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:59 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1751 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:59.671587 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-14ac4ae4-9220-4f73-aff5-87f5f93a737f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:59.672464 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-14ac4ae4-9220-4f73-aff5-87f5f93a737f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:59.688147 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-14ac4ae4-9220-4f73-aff5-87f5f93a737f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:59.688737 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-14ac4ae4-9220-4f73-aff5-87f5f93a737f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:59.689278 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-14ac4ae4-9220-4f73-aff5-87f5f93a737f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:59.690047 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-14ac4ae4-9220-4f73-aff5-87f5f93a737f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:59.690709 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-14ac4ae4-9220-4f73-aff5-87f5f93a737f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:59.691133 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-14ac4ae4-9220-4f73-aff5-87f5f93a737f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:59.778230 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-c6f38236-89df-4d05-86a3-cf891cf43243 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:59.778873 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-c6f38236-89df-4d05-86a3-cf891cf43243 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 361dfd3b-f488-4dac-9511-f28c93f74d37] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:59.789615 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c6f38236-89df-4d05-86a3-cf891cf43243 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:59.794284 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c6f38236-89df-4d05-86a3-cf891cf43243 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:59.794966 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c6f38236-89df-4d05-86a3-cf891cf43243 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:59.795924 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c6f38236-89df-4d05-86a3-cf891cf43243 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:59.796530 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c6f38236-89df-4d05-86a3-cf891cf43243 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:59.797226 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c6f38236-89df-4d05-86a3-cf891cf43243 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:59.848809 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-14ac4ae4-9220-4f73-aff5-87f5f93a737f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:59.858927 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-14ac4ae4-9220-4f73-aff5-87f5f93a737f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1679 microversion: 2.1 time: 0.191350 Oct 19 00:44:59.860166 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 349/715] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:59 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1679 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:59.881808 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c6f38236-89df-4d05-86a3-cf891cf43243 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:59.882553 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c6f38236-89df-4d05-86a3-cf891cf43243 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:59.883138 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c6f38236-89df-4d05-86a3-cf891cf43243 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:59.883773 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.objects.instance [None req-c6f38236-89df-4d05-86a3-cf891cf43243 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lazy-loading 'fault' on Instance uuid 361dfd3b-f488-4dac-9511-f28c93f74d37 {{(pid=125532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:44:59.950864 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-c6f38236-89df-4d05-86a3-cf891cf43243 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:59.964378 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-c6f38236-89df-4d05-86a3-cf891cf43243 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37" status: 200 len: 1330 microversion: 2.1 time: 0.199266 Oct 19 00:44:59.965487 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 367/716] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:59 2022] GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37 => generated 1330 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:45:00.530537 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-a8390af4-67ea-45b3-90f1-56f6401b1849 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:00.531177 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-a8390af4-67ea-45b3-90f1-56f6401b1849 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:00.538005 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a8390af4-67ea-45b3-90f1-56f6401b1849 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:00.538479 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a8390af4-67ea-45b3-90f1-56f6401b1849 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:00.538908 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a8390af4-67ea-45b3-90f1-56f6401b1849 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:00.539584 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a8390af4-67ea-45b3-90f1-56f6401b1849 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:00.540060 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a8390af4-67ea-45b3-90f1-56f6401b1849 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:00.541611 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a8390af4-67ea-45b3-90f1-56f6401b1849 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:00.694061 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-a8390af4-67ea-45b3-90f1-56f6401b1849 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:00.702398 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-a8390af4-67ea-45b3-90f1-56f6401b1849 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1751 microversion: 2.1 time: 0.175769 Oct 19 00:45:00.702969 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 350/717] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:00 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1751 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:00.886160 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-35eb5f54-154f-46eb-8c27-33484ee5a5e6 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:00.886796 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-35eb5f54-154f-46eb-8c27-33484ee5a5e6 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:00.893342 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-35eb5f54-154f-46eb-8c27-33484ee5a5e6 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:00.893826 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-35eb5f54-154f-46eb-8c27-33484ee5a5e6 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:00.894288 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-35eb5f54-154f-46eb-8c27-33484ee5a5e6 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:00.895573 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-35eb5f54-154f-46eb-8c27-33484ee5a5e6 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:00.896064 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-35eb5f54-154f-46eb-8c27-33484ee5a5e6 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:00.896490 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-35eb5f54-154f-46eb-8c27-33484ee5a5e6 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:01.001810 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-34a2521b-527f-477d-9d4a-cb97b033ef49 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:01.002426 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-34a2521b-527f-477d-9d4a-cb97b033ef49 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 361dfd3b-f488-4dac-9511-f28c93f74d37] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:01.005392 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:01.010100 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-34a2521b-527f-477d-9d4a-cb97b033ef49 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:01.010583 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-34a2521b-527f-477d-9d4a-cb97b033ef49 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:01.011020 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-34a2521b-527f-477d-9d4a-cb97b033ef49 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:01.011713 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-34a2521b-527f-477d-9d4a-cb97b033ef49 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:01.012346 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-34a2521b-527f-477d-9d4a-cb97b033ef49 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:01.012932 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-34a2521b-527f-477d-9d4a-cb97b033ef49 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:01.033276 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-35eb5f54-154f-46eb-8c27-33484ee5a5e6 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:01.036069 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.wsgi [None req-34a2521b-527f-477d-9d4a-cb97b033ef49 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] HTTP exception thrown: Instance 361dfd3b-f488-4dac-9511-f28c93f74d37 could not be found. Oct 19 00:45:01.037874 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-34a2521b-527f-477d-9d4a-cb97b033ef49 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Request method failure captured: Oct 19 00:45:01.037874 dv-cinder-master-3-smb devstack@n-api.service[125531]: request: GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37 HTTP/1.1 Oct 19 00:45:01.037874 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept: application/json Oct 19 00:45:01.037874 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept-Encoding: identity Oct 19 00:45:01.037874 dv-cinder-master-3-smb devstack@n-api.service[125531]: Connection: close Oct 19 00:45:01.037874 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Length: 0 Oct 19 00:45:01.037874 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Type: application/json Oct 19 00:45:01.037874 dv-cinder-master-3-smb devstack@n-api.service[125531]: Host: 10.222.0.33 Oct 19 00:45:01.037874 dv-cinder-master-3-smb devstack@n-api.service[125531]: Openstack-System-Scope: None Oct 19 00:45:01.037874 dv-cinder-master-3-smb devstack@n-api.service[125531]: User-Agent: python-urllib3/1.26.12 Oct 19 00:45:01.037874 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Auth-Token: gAAAAABjT0dZO9Cl1BpR1E_5nrd-9g_6W01GCmRr-bxs2oosEmvGRcrx0Y-G0IKovE-TfQsuTKO_S4_zWYg0zNU477VxKqXUVmnxsIfPQLMl-kk4S2RGLMvzztHdGHZY35kfzLdr41wbpFPN7pnfATDs8WY4-rnm9WtQvzLBNibrb2MPfqFKqcA Oct 19 00:45:01.037874 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Id: None Oct 19 00:45:01.037874 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Name: None Oct 19 00:45:01.037874 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Identity-Status: Confirmed Oct 19 00:45:01.037874 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Is-Admin-Project: True Oct 19 00:45:01.037874 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Id: default Oct 19 00:45:01.037874 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Name: Default Oct 19 00:45:01.037874 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Id: 4081d4f735b04367a67a03b9539f5432 Oct 19 00:45:01.037874 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Name: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:45:01.037874 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Role: member,reader Oct 19 00:45:01.037874 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Roles: member,reader Oct 19 00:45:01.039531 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4081d4f735b04367a67a03b9539f5432"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:45:01.039531 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:45:01.039531 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Id: 4081d4f735b04367a67a03b9539f5432 Oct 19 00:45:01.039531 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:45:01.039531 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User: tempest-AttachVolumeNegativeTest-339799867-project Oct 19 00:45:01.039531 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Id: default Oct 19 00:45:01.039531 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Name: Default Oct 19 00:45:01.039531 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Id: 5f9a55c605f04f478d0a71679d8bf6a1 Oct 19 00:45:01.039531 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Name: tempest-AttachVolumeNegativeTest-339799867-project Oct 19 00:45:01.039531 dv-cinder-master-3-smb devstack@n-api.service[125531]: method: > Oct 19 00:45:01.039531 dv-cinder-master-3-smb devstack@n-api.service[125531]: exception: Instance 361dfd3b-f488-4dac-9511-f28c93f74d37 could not be found. Oct 19 00:45:01.039531 dv-cinder-master-3-smb devstack@n-api.service[125531]: action_args: {'id': '361dfd3b-f488-4dac-9511-f28c93f74d37'} Oct 19 00:45:01.040391 dv-cinder-master-3-smb devstack@n-api.service[125531]: {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:45:01.040391 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:01.040391 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:45:01.040391 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:45:01.040391 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:45:01.040391 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:45:01.040391 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:45:01.040391 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:45:01.040391 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:45:01.040391 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:45:01.040391 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 361dfd3b-f488-4dac-9511-f28c93f74d37 could not be found. Oct 19 00:45:01.040391 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:45:01.040391 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:45:01.040391 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:45:01.040391 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:01.040391 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:45:01.040391 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:45:01.040391 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:45:01.040391 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:45:01.040391 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:45:01.041609 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:45:01.041609 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:45:01.041609 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:45:01.041609 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:45:01.041609 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:45:01.041609 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:45:01.041609 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:45:01.041609 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 361dfd3b-f488-4dac-9511-f28c93f74d37 could not be found. Oct 19 00:45:01.041609 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:45:01.041609 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:45:01.041609 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:45:01.041609 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:01.041609 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:45:01.041609 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:45:01.041609 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:45:01.041609 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:45:01.041609 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 361dfd3b-f488-4dac-9511-f28c93f74d37 could not be found. Oct 19 00:45:01.041609 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:45:01.042666 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-34a2521b-527f-477d-9d4a-cb97b033ef49 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Returning 404 to user: Instance 361dfd3b-f488-4dac-9511-f28c93f74d37 could not be found. {{(pid=125531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:45:01.042666 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-34a2521b-527f-477d-9d4a-cb97b033ef49 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37" status: 404 len: 111 microversion: 2.1 time: 0.041369 Oct 19 00:45:01.042666 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 351/718] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:00 2022] GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:45:01.047808 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-52b63a87-bf20-4795-92ae-8bbd56cbcc30 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '.version_select at 0x7f81f0d75d30>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:01.053317 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-35eb5f54-154f-46eb-8c27-33484ee5a5e6 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1679 microversion: 2.1 time: 0.170945 Oct 19 00:45:01.053890 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 368/719] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:00 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:01.067240 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-52b63a87-bf20-4795-92ae-8bbd56cbcc30 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-998982525" status: 202 len: 0 microversion: 2.1 time: 0.023032 Oct 19 00:45:01.068217 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 352/720] 10.222.0.33 () {58 vars in 1218 bytes} [Wed Oct 19 00:45:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-998982525 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 00:45:01.697764 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-4d51abd3-97ca-41e5-b20d-0d53f6226003 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Action: 'create', calling method: .version_select at 0x7f81f102c4c0>, body: {"keypair": {"name": "tempest-keypair-1772851410", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNupjyvJdB56HO6KIm6FaUs4TrGrAhYgVkAp2hjBi6GbQqF+/0S8bo8kCPiM9S1vthoSCHUDxUu84+Wx2/PIQLBub+CABgem2jOHKbCVMxXTCU1+U2zItAbeEhkwbvUtEg=="}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:01.712854 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.quota [None req-4d51abd3-97ca-41e5-b20d-0d53f6226003 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Getting quotas for project 4081d4f735b04367a67a03b9539f5432. Resources: {'key_pairs'} {{(pid=125532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:45:01.716703 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.quota [None req-4d51abd3-97ca-41e5-b20d-0d53f6226003 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Getting quotas for user 5f9a55c605f04f478d0a71679d8bf6a1 and project 4081d4f735b04367a67a03b9539f5432. Resources: {'key_pairs'} {{(pid=125532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:45:01.726716 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-9dac0934-5e8e-4622-957b-9a01d168c589 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:01.727329 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-9dac0934-5e8e-4622-957b-9a01d168c589 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:01.734150 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9dac0934-5e8e-4622-957b-9a01d168c589 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:01.734700 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9dac0934-5e8e-4622-957b-9a01d168c589 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:01.735136 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9dac0934-5e8e-4622-957b-9a01d168c589 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:01.735917 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9dac0934-5e8e-4622-957b-9a01d168c589 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:01.736376 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9dac0934-5e8e-4622-957b-9a01d168c589 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:01.736802 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9dac0934-5e8e-4622-957b-9a01d168c589 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:01.746231 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-4d51abd3-97ca-41e5-b20d-0d53f6226003 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052247 Oct 19 00:45:01.746928 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 369/721] 10.222.0.33 () {60 vars in 1159 bytes} [Wed Oct 19 00:45:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:01.953005 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-9dac0934-5e8e-4622-957b-9a01d168c589 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:01.961822 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-9dac0934-5e8e-4622-957b-9a01d168c589 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1756 microversion: 2.1 time: 0.239393 Oct 19 00:45:01.962658 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 353/722] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:01 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1756 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:45:02.077552 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-8059ca73-b0b3-46d8-99bb-02209a895cec tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:02.078196 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-8059ca73-b0b3-46d8-99bb-02209a895cec tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:02.084775 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8059ca73-b0b3-46d8-99bb-02209a895cec tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:02.085342 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8059ca73-b0b3-46d8-99bb-02209a895cec tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:02.085908 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8059ca73-b0b3-46d8-99bb-02209a895cec tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:02.086857 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8059ca73-b0b3-46d8-99bb-02209a895cec tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:02.087356 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8059ca73-b0b3-46d8-99bb-02209a895cec tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:02.087789 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8059ca73-b0b3-46d8-99bb-02209a895cec tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:02.240904 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-8059ca73-b0b3-46d8-99bb-02209a895cec tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:02.251220 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-8059ca73-b0b3-46d8-99bb-02209a895cec tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1679 microversion: 2.1 time: 0.177081 Oct 19 00:45:02.252618 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 370/723] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:02 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1679 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:02.985687 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-48a5971e-5ded-458d-b841-c9c4fe5791d2 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:02.986307 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-48a5971e-5ded-458d-b841-c9c4fe5791d2 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:02.993924 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-48a5971e-5ded-458d-b841-c9c4fe5791d2 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:02.994414 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-48a5971e-5ded-458d-b841-c9c4fe5791d2 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:02.994858 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-48a5971e-5ded-458d-b841-c9c4fe5791d2 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:02.995620 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-48a5971e-5ded-458d-b841-c9c4fe5791d2 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:02.996114 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-48a5971e-5ded-458d-b841-c9c4fe5791d2 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:02.996571 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-48a5971e-5ded-458d-b841-c9c4fe5791d2 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:03.107465 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-4f7db596-ed73-403d-a3fa-6df5e2e47b9e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1970236208", "imageRef": "d1f4abc9-3bb9-4343-9a05-53d758070c9d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e4e49b3c-1347-4eda-9be1-f1139c6e3c46"}], "security_groups": [{"name": "tempest-securitygroup--789466484"}], "key_name": "tempest-keypair-1772851410", "user_data": "}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:03.148185 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-48a5971e-5ded-458d-b841-c9c4fe5791d2 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:03.156672 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-48a5971e-5ded-458d-b841-c9c4fe5791d2 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1756 microversion: 2.1 time: 0.174836 Oct 19 00:45:03.157265 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 354/724] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:02 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:03.216057 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.network.neutron [None req-4f7db596-ed73-403d-a3fa-6df5e2e47b9e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] validate_networks() for [('e4e49b3c-1347-4eda-9be1-f1139c6e3c46', None, None, None, None, None)] {{(pid=125532) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:45:03.276457 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-a2773258-dbe5-4e07-870d-fbc2523f634f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:03.277065 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-a2773258-dbe5-4e07-870d-fbc2523f634f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:03.282830 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a2773258-dbe5-4e07-870d-fbc2523f634f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:03.283308 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a2773258-dbe5-4e07-870d-fbc2523f634f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:03.283741 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a2773258-dbe5-4e07-870d-fbc2523f634f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:03.284449 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a2773258-dbe5-4e07-870d-fbc2523f634f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:03.284895 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a2773258-dbe5-4e07-870d-fbc2523f634f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:03.285969 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a2773258-dbe5-4e07-870d-fbc2523f634f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:03.431025 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-a2773258-dbe5-4e07-870d-fbc2523f634f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:03.439317 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-a2773258-dbe5-4e07-870d-fbc2523f634f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1679 microversion: 2.1 time: 0.166651 Oct 19 00:45:03.439918 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 355/725] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:03 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:45:03.659790 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-4f7db596-ed73-403d-a3fa-6df5e2e47b9e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Flavor limits 0:0:0 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:45:03.661046 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-4f7db596-ed73-403d-a3fa-6df5e2e47b9e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Image limits 0:0:0 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:45:03.661544 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-4f7db596-ed73-403d-a3fa-6df5e2e47b9e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Flavor pref 0:0:0 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:45:03.661957 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-4f7db596-ed73-403d-a3fa-6df5e2e47b9e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Image pref 0:0:0 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:45:03.662371 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-4f7db596-ed73-403d-a3fa-6df5e2e47b9e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:45:03.670965 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4f7db596-ed73-403d-a3fa-6df5e2e47b9e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:03.671461 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4f7db596-ed73-403d-a3fa-6df5e2e47b9e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:03.671907 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4f7db596-ed73-403d-a3fa-6df5e2e47b9e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:03.672642 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4f7db596-ed73-403d-a3fa-6df5e2e47b9e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:03.673098 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4f7db596-ed73-403d-a3fa-6df5e2e47b9e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:03.673526 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4f7db596-ed73-403d-a3fa-6df5e2e47b9e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:03.690669 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.quota [None req-4f7db596-ed73-403d-a3fa-6df5e2e47b9e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Getting quotas for project 4081d4f735b04367a67a03b9539f5432. Resources: {'instances', 'cores', 'ram'} {{(pid=125532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:45:03.694805 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.quota [None req-4f7db596-ed73-403d-a3fa-6df5e2e47b9e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Getting quotas for user 5f9a55c605f04f478d0a71679d8bf6a1 and project 4081d4f735b04367a67a03b9539f5432. Resources: {'instances', 'cores', 'ram'} {{(pid=125532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:45:03.706429 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-4f7db596-ed73-403d-a3fa-6df5e2e47b9e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Going to run 1 instances... {{(pid=125532) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:45:03.709077 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-4f7db596-ed73-403d-a3fa-6df5e2e47b9e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: bf3b9e96-22bd-44d1-9871-6a454de72bbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1f4abc9-3bb9-4343-9a05-53d758070c9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125532) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:45:03.757136 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-4f7db596-ed73-403d-a3fa-6df5e2e47b9e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.653885 Oct 19 00:45:03.757774 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 371/726] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Oct 19 00:45:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 00:45:03.770346 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-e19e3e4d-f87b-4f59-8189-9e3a6d06e5a8 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:03.771132 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-e19e3e4d-f87b-4f59-8189-9e3a6d06e5a8 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: bf3b9e96-22bd-44d1-9871-6a454de72bbe] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:03.824355 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-e19e3e4d-f87b-4f59-8189-9e3a6d06e5a8 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:03.836676 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-e19e3e4d-f87b-4f59-8189-9e3a6d06e5a8 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe" status: 200 len: 1242 microversion: 2.1 time: 0.071214 Oct 19 00:45:03.837253 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 356/727] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:03 2022] GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:04.181514 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-9c915641-e3e8-421e-b98f-0f5de81f330f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:04.182250 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-9c915641-e3e8-421e-b98f-0f5de81f330f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:04.189146 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9c915641-e3e8-421e-b98f-0f5de81f330f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:04.189633 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9c915641-e3e8-421e-b98f-0f5de81f330f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:04.190068 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9c915641-e3e8-421e-b98f-0f5de81f330f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:04.190786 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9c915641-e3e8-421e-b98f-0f5de81f330f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:04.191239 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9c915641-e3e8-421e-b98f-0f5de81f330f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:04.192438 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9c915641-e3e8-421e-b98f-0f5de81f330f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:04.350848 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-9c915641-e3e8-421e-b98f-0f5de81f330f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:04.359018 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-9c915641-e3e8-421e-b98f-0f5de81f330f tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1756 microversion: 2.1 time: 0.182246 Oct 19 00:45:04.359574 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 372/728] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:04 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:04.463139 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-844ca857-1c40-4d19-ad57-3ae47b3722cd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:04.463887 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-844ca857-1c40-4d19-ad57-3ae47b3722cd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:04.470418 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-844ca857-1c40-4d19-ad57-3ae47b3722cd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:04.470897 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-844ca857-1c40-4d19-ad57-3ae47b3722cd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:04.471329 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-844ca857-1c40-4d19-ad57-3ae47b3722cd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:04.472048 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-844ca857-1c40-4d19-ad57-3ae47b3722cd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:04.472501 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-844ca857-1c40-4d19-ad57-3ae47b3722cd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:04.473785 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-844ca857-1c40-4d19-ad57-3ae47b3722cd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:04.614246 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-844ca857-1c40-4d19-ad57-3ae47b3722cd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:04.622287 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-844ca857-1c40-4d19-ad57-3ae47b3722cd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1679 microversion: 2.1 time: 0.163321 Oct 19 00:45:04.622855 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 357/729] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:04 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:04.859681 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-d5128988-d57c-460a-ab8f-f2002bf17fea tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:04.860271 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-d5128988-d57c-460a-ab8f-f2002bf17fea tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: bf3b9e96-22bd-44d1-9871-6a454de72bbe] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:04.867336 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d5128988-d57c-460a-ab8f-f2002bf17fea tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:04.867886 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d5128988-d57c-460a-ab8f-f2002bf17fea tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:04.868301 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d5128988-d57c-460a-ab8f-f2002bf17fea tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:04.868988 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d5128988-d57c-460a-ab8f-f2002bf17fea tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:04.869493 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d5128988-d57c-460a-ab8f-f2002bf17fea tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:04.869920 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d5128988-d57c-460a-ab8f-f2002bf17fea tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:04.934754 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-d5128988-d57c-460a-ab8f-f2002bf17fea tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:04.942935 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-d5128988-d57c-460a-ab8f-f2002bf17fea tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe" status: 200 len: 1294 microversion: 2.1 time: 0.087168 Oct 19 00:45:04.943494 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 373/730] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:04 2022] GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe => generated 1294 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:05.382988 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-9b7577f4-0a02-4a47-a854-cdce673b5682 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:05.383601 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-9b7577f4-0a02-4a47-a854-cdce673b5682 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:05.389523 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9b7577f4-0a02-4a47-a854-cdce673b5682 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:05.390006 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9b7577f4-0a02-4a47-a854-cdce673b5682 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:05.390439 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9b7577f4-0a02-4a47-a854-cdce673b5682 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:05.391124 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9b7577f4-0a02-4a47-a854-cdce673b5682 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:05.391579 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9b7577f4-0a02-4a47-a854-cdce673b5682 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:05.392031 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9b7577f4-0a02-4a47-a854-cdce673b5682 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:05.531767 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-9b7577f4-0a02-4a47-a854-cdce673b5682 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:05.540152 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-9b7577f4-0a02-4a47-a854-cdce673b5682 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1756 microversion: 2.1 time: 0.161593 Oct 19 00:45:05.540721 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 358/731] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:05 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:05.645084 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-ee55ed0e-7bc3-4b3c-b21c-cc80b3393564 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:05.645691 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-ee55ed0e-7bc3-4b3c-b21c-cc80b3393564 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:05.652061 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ee55ed0e-7bc3-4b3c-b21c-cc80b3393564 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:05.652540 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ee55ed0e-7bc3-4b3c-b21c-cc80b3393564 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:05.652967 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ee55ed0e-7bc3-4b3c-b21c-cc80b3393564 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:05.653650 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ee55ed0e-7bc3-4b3c-b21c-cc80b3393564 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:05.654097 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ee55ed0e-7bc3-4b3c-b21c-cc80b3393564 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:05.654517 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ee55ed0e-7bc3-4b3c-b21c-cc80b3393564 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:05.877838 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-ee55ed0e-7bc3-4b3c-b21c-cc80b3393564 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:05.886480 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-ee55ed0e-7bc3-4b3c-b21c-cc80b3393564 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1679 microversion: 2.1 time: 0.245327 Oct 19 00:45:05.887044 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 374/732] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:05 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1679 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:05.967701 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-a95315de-b04e-43a5-971f-b75c54c7ccde tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:05.968340 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-a95315de-b04e-43a5-971f-b75c54c7ccde tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: bf3b9e96-22bd-44d1-9871-6a454de72bbe] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:05.977188 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a95315de-b04e-43a5-971f-b75c54c7ccde tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:05.978146 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a95315de-b04e-43a5-971f-b75c54c7ccde tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:05.978911 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a95315de-b04e-43a5-971f-b75c54c7ccde tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:05.980195 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a95315de-b04e-43a5-971f-b75c54c7ccde tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:05.980701 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a95315de-b04e-43a5-971f-b75c54c7ccde tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:05.981137 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a95315de-b04e-43a5-971f-b75c54c7ccde tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:06.236226 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-a95315de-b04e-43a5-971f-b75c54c7ccde tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:06.246672 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-a95315de-b04e-43a5-971f-b75c54c7ccde tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe" status: 200 len: 1367 microversion: 2.1 time: 0.283929 Oct 19 00:45:06.248879 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 359/733] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:05 2022] GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe => generated 1367 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:06.563740 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-50deeda9-807b-49f5-92f6-c56c62b3eff6 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:06.564472 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-50deeda9-807b-49f5-92f6-c56c62b3eff6 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:06.571390 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-50deeda9-807b-49f5-92f6-c56c62b3eff6 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:06.572049 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-50deeda9-807b-49f5-92f6-c56c62b3eff6 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:06.572548 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-50deeda9-807b-49f5-92f6-c56c62b3eff6 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:06.573296 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-50deeda9-807b-49f5-92f6-c56c62b3eff6 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:06.573841 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-50deeda9-807b-49f5-92f6-c56c62b3eff6 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:06.574325 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-50deeda9-807b-49f5-92f6-c56c62b3eff6 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:06.911527 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-1ffe4f73-a0bc-4039-ba90-9e05f5cb5263 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:06.912645 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-1ffe4f73-a0bc-4039-ba90-9e05f5cb5263 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:06.918945 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1ffe4f73-a0bc-4039-ba90-9e05f5cb5263 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:06.919425 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1ffe4f73-a0bc-4039-ba90-9e05f5cb5263 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:06.920063 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1ffe4f73-a0bc-4039-ba90-9e05f5cb5263 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:06.920953 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1ffe4f73-a0bc-4039-ba90-9e05f5cb5263 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:06.921411 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1ffe4f73-a0bc-4039-ba90-9e05f5cb5263 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:06.921825 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1ffe4f73-a0bc-4039-ba90-9e05f5cb5263 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:07.074686 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-50deeda9-807b-49f5-92f6-c56c62b3eff6 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:07.084998 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-50deeda9-807b-49f5-92f6-c56c62b3eff6 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1756 microversion: 2.1 time: 0.524880 Oct 19 00:45:07.086550 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 375/734] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:06 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1756 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:07.135340 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-1ffe4f73-a0bc-4039-ba90-9e05f5cb5263 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:07.144172 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-1ffe4f73-a0bc-4039-ba90-9e05f5cb5263 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1656 microversion: 2.1 time: 0.237181 Oct 19 00:45:07.160485 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 360/735] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:06 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1656 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:07.168074 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-138f4e81-99ee-43cb-9f03-a45f389c4e53 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:07.185811 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-138f4e81-99ee-43cb-9f03-a45f389c4e53 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:07.187122 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-138f4e81-99ee-43cb-9f03-a45f389c4e53 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:07.187972 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-138f4e81-99ee-43cb-9f03-a45f389c4e53 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:07.221661 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-138f4e81-99ee-43cb-9f03-a45f389c4e53 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Going to try to start instance {{(pid=125532) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 19 00:45:07.272270 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-0255511d-fce9-4783-a5d9-2a1bb1b8b3c9 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:07.273265 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-0255511d-fce9-4783-a5d9-2a1bb1b8b3c9 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: bf3b9e96-22bd-44d1-9871-6a454de72bbe] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:07.274592 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-138f4e81-99ee-43cb-9f03-a45f389c4e53 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "POST /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654/action" status: 202 len: 0 microversion: 2.1 time: 0.110173 Oct 19 00:45:07.275621 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 376/736] 10.222.0.33 () {60 vars in 1278 bytes} [Wed Oct 19 00:45:07 2022] POST /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:45:07.280506 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0255511d-fce9-4783-a5d9-2a1bb1b8b3c9 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:07.281280 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0255511d-fce9-4783-a5d9-2a1bb1b8b3c9 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:07.281976 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0255511d-fce9-4783-a5d9-2a1bb1b8b3c9 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:07.282889 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0255511d-fce9-4783-a5d9-2a1bb1b8b3c9 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:07.283990 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0255511d-fce9-4783-a5d9-2a1bb1b8b3c9 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:07.284579 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0255511d-fce9-4783-a5d9-2a1bb1b8b3c9 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:07.286781 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-ee6952c7-3bbb-4207-9f39-3e0db6aeb682 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:07.289016 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-ee6952c7-3bbb-4207-9f39-3e0db6aeb682 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:07.301451 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ee6952c7-3bbb-4207-9f39-3e0db6aeb682 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:07.302780 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ee6952c7-3bbb-4207-9f39-3e0db6aeb682 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:07.303319 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ee6952c7-3bbb-4207-9f39-3e0db6aeb682 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:07.304159 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ee6952c7-3bbb-4207-9f39-3e0db6aeb682 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:07.304762 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ee6952c7-3bbb-4207-9f39-3e0db6aeb682 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:07.305275 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-ee6952c7-3bbb-4207-9f39-3e0db6aeb682 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:07.310212 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:07.466202 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-0255511d-fce9-4783-a5d9-2a1bb1b8b3c9 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:07.478224 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-0255511d-fce9-4783-a5d9-2a1bb1b8b3c9 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe" status: 200 len: 1367 microversion: 2.1 time: 0.209713 Oct 19 00:45:07.478897 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 361/737] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:07 2022] GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:07.484652 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-4fbf79cd-83d7-4988-b41c-076da1074f3a req-f8847d8e-58ef-433f-8d34-a379e2fc0be7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf3b9e96-22bd-44d1-9871-6a454de72bbe", "tag": "503b0fd3-4b77-41f7-8483-4834ad6947f7"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:07.496094 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-4fbf79cd-83d7-4988-b41c-076da1074f3a req-f8847d8e-58ef-433f-8d34-a379e2fc0be7 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:07.497611 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-4fbf79cd-83d7-4988-b41c-076da1074f3a req-f8847d8e-58ef-433f-8d34-a379e2fc0be7 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:07.498044 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-4fbf79cd-83d7-4988-b41c-076da1074f3a req-f8847d8e-58ef-433f-8d34-a379e2fc0be7 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:07.511400 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-4fbf79cd-83d7-4988-b41c-076da1074f3a req-f8847d8e-58ef-433f-8d34-a379e2fc0be7 service nova] Creating event network-changed:503b0fd3-4b77-41f7-8483-4834ad6947f7 for instance bf3b9e96-22bd-44d1-9871-6a454de72bbe on hv-cinder-maste Oct 19 00:45:07.516806 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-4fbf79cd-83d7-4988-b41c-076da1074f3a req-f8847d8e-58ef-433f-8d34-a379e2fc0be7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036615 Oct 19 00:45:07.517964 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 362/738] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:07.671754 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-ee6952c7-3bbb-4207-9f39-3e0db6aeb682 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:07.682023 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-ee6952c7-3bbb-4207-9f39-3e0db6aeb682 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1665 microversion: 2.1 time: 0.402369 Oct 19 00:45:07.684527 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 377/739] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:07 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1665 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:08.112863 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-31727ca9-21ac-47e2-a0bf-b5f85a6b1543 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:08.113737 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-31727ca9-21ac-47e2-a0bf-b5f85a6b1543 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:08.120924 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-31727ca9-21ac-47e2-a0bf-b5f85a6b1543 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:08.121698 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-31727ca9-21ac-47e2-a0bf-b5f85a6b1543 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:08.122254 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-31727ca9-21ac-47e2-a0bf-b5f85a6b1543 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:08.123047 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-31727ca9-21ac-47e2-a0bf-b5f85a6b1543 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:08.123739 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-31727ca9-21ac-47e2-a0bf-b5f85a6b1543 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:08.124341 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-31727ca9-21ac-47e2-a0bf-b5f85a6b1543 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:08.367494 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-31727ca9-21ac-47e2-a0bf-b5f85a6b1543 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:08.385809 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-31727ca9-21ac-47e2-a0bf-b5f85a6b1543 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1756 microversion: 2.1 time: 0.277185 Oct 19 00:45:08.386526 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 363/740] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:08 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1756 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:08.504548 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-52124232-9b60-4512-be27-2f15599a5e09 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:08.505247 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-52124232-9b60-4512-be27-2f15599a5e09 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: bf3b9e96-22bd-44d1-9871-6a454de72bbe] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:08.510997 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:08.512671 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-52124232-9b60-4512-be27-2f15599a5e09 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:08.513208 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-52124232-9b60-4512-be27-2f15599a5e09 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:08.513716 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-52124232-9b60-4512-be27-2f15599a5e09 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:08.514491 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-52124232-9b60-4512-be27-2f15599a5e09 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:08.515021 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-52124232-9b60-4512-be27-2f15599a5e09 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:08.515981 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-52124232-9b60-4512-be27-2f15599a5e09 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:08.706514 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-338df125-13ea-4b1b-bb33-d63826a53e25 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:08.707464 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-338df125-13ea-4b1b-bb33-d63826a53e25 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:08.713652 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-338df125-13ea-4b1b-bb33-d63826a53e25 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:08.714139 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-338df125-13ea-4b1b-bb33-d63826a53e25 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:08.714601 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-338df125-13ea-4b1b-bb33-d63826a53e25 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:08.715294 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-338df125-13ea-4b1b-bb33-d63826a53e25 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:08.715747 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-338df125-13ea-4b1b-bb33-d63826a53e25 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:08.716274 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-338df125-13ea-4b1b-bb33-d63826a53e25 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:08.733099 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-52124232-9b60-4512-be27-2f15599a5e09 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:08.741970 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-52124232-9b60-4512-be27-2f15599a5e09 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe" status: 200 len: 1367 microversion: 2.1 time: 0.241838 Oct 19 00:45:08.742668 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 378/741] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:08 2022] GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:08.863298 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-338df125-13ea-4b1b-bb33-d63826a53e25 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:08.872376 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-338df125-13ea-4b1b-bb33-d63826a53e25 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1665 microversion: 2.1 time: 0.169770 Oct 19 00:45:08.872954 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 364/742] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:08 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1665 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:45:09.411172 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-411e1a39-0e9e-40ac-b2e2-871e8786cc63 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:09.412288 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-411e1a39-0e9e-40ac-b2e2-871e8786cc63 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:09.421416 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-411e1a39-0e9e-40ac-b2e2-871e8786cc63 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:09.422483 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-411e1a39-0e9e-40ac-b2e2-871e8786cc63 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:09.423016 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-411e1a39-0e9e-40ac-b2e2-871e8786cc63 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:09.424129 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-411e1a39-0e9e-40ac-b2e2-871e8786cc63 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:09.424808 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-411e1a39-0e9e-40ac-b2e2-871e8786cc63 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:09.425331 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-411e1a39-0e9e-40ac-b2e2-871e8786cc63 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:09.697401 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-411e1a39-0e9e-40ac-b2e2-871e8786cc63 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:09.709108 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-411e1a39-0e9e-40ac-b2e2-871e8786cc63 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1756 microversion: 2.1 time: 0.302824 Oct 19 00:45:09.711890 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 379/743] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:09 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1756 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:09.767420 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-2507d899-b9e2-49a4-924e-6cfe33a1f3d3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:09.768807 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-2507d899-b9e2-49a4-924e-6cfe33a1f3d3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: bf3b9e96-22bd-44d1-9871-6a454de72bbe] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:09.781909 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2507d899-b9e2-49a4-924e-6cfe33a1f3d3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:09.782391 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2507d899-b9e2-49a4-924e-6cfe33a1f3d3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:09.782826 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2507d899-b9e2-49a4-924e-6cfe33a1f3d3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:09.783638 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2507d899-b9e2-49a4-924e-6cfe33a1f3d3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:09.784119 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2507d899-b9e2-49a4-924e-6cfe33a1f3d3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:09.784538 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2507d899-b9e2-49a4-924e-6cfe33a1f3d3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:09.897144 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-3f95cab5-932b-4461-908c-ff2840461e5f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:09.897933 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-3f95cab5-932b-4461-908c-ff2840461e5f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:09.905882 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3f95cab5-932b-4461-908c-ff2840461e5f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:09.907481 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3f95cab5-932b-4461-908c-ff2840461e5f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:09.908787 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3f95cab5-932b-4461-908c-ff2840461e5f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:09.909795 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3f95cab5-932b-4461-908c-ff2840461e5f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:09.911174 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3f95cab5-932b-4461-908c-ff2840461e5f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:09.912011 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3f95cab5-932b-4461-908c-ff2840461e5f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:09.952019 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-2507d899-b9e2-49a4-924e-6cfe33a1f3d3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:09.960472 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-2507d899-b9e2-49a4-924e-6cfe33a1f3d3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe" status: 200 len: 1367 microversion: 2.1 time: 0.198784 Oct 19 00:45:09.961184 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 365/744] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:09 2022] GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:10.210237 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-3f95cab5-932b-4461-908c-ff2840461e5f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:10.220502 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-3f95cab5-932b-4461-908c-ff2840461e5f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1665 microversion: 2.1 time: 0.328110 Oct 19 00:45:10.221200 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 380/745] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:09 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1665 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:45:10.734813 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-8bcee705-721f-4747-90dd-c6f8fc0fe3b3 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:10.735574 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-8bcee705-721f-4747-90dd-c6f8fc0fe3b3 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:10.742836 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8bcee705-721f-4747-90dd-c6f8fc0fe3b3 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:10.743336 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8bcee705-721f-4747-90dd-c6f8fc0fe3b3 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:10.743732 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8bcee705-721f-4747-90dd-c6f8fc0fe3b3 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:10.744462 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8bcee705-721f-4747-90dd-c6f8fc0fe3b3 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:10.744909 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8bcee705-721f-4747-90dd-c6f8fc0fe3b3 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:10.745359 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8bcee705-721f-4747-90dd-c6f8fc0fe3b3 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:10.989663 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-57ca8b04-6a80-4f36-aea6-be39b0dc97a4 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:10.991260 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-57ca8b04-6a80-4f36-aea6-be39b0dc97a4 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: bf3b9e96-22bd-44d1-9871-6a454de72bbe] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:11.004193 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-57ca8b04-6a80-4f36-aea6-be39b0dc97a4 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:11.005477 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-57ca8b04-6a80-4f36-aea6-be39b0dc97a4 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:11.006156 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-57ca8b04-6a80-4f36-aea6-be39b0dc97a4 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:11.007208 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-57ca8b04-6a80-4f36-aea6-be39b0dc97a4 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:11.008207 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-57ca8b04-6a80-4f36-aea6-be39b0dc97a4 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:11.008862 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-57ca8b04-6a80-4f36-aea6-be39b0dc97a4 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:11.115639 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-8bcee705-721f-4747-90dd-c6f8fc0fe3b3 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:11.125447 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-8bcee705-721f-4747-90dd-c6f8fc0fe3b3 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1756 microversion: 2.1 time: 0.395614 Oct 19 00:45:11.144101 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 366/746] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:10 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1756 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:11.235020 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-57ca8b04-6a80-4f36-aea6-be39b0dc97a4 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:11.245181 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-57ca8b04-6a80-4f36-aea6-be39b0dc97a4 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe" status: 200 len: 1367 microversion: 2.1 time: 0.260571 Oct 19 00:45:11.246253 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-840d73e4-068a-4cfc-8f47-9acbd5ab99ad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:11.246917 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-840d73e4-068a-4cfc-8f47-9acbd5ab99ad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:11.250556 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 381/747] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:10 2022] GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:11.254094 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-840d73e4-068a-4cfc-8f47-9acbd5ab99ad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:11.254646 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-840d73e4-068a-4cfc-8f47-9acbd5ab99ad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:11.255137 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-840d73e4-068a-4cfc-8f47-9acbd5ab99ad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:11.256667 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-840d73e4-068a-4cfc-8f47-9acbd5ab99ad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:11.257271 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-840d73e4-068a-4cfc-8f47-9acbd5ab99ad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:11.257842 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-840d73e4-068a-4cfc-8f47-9acbd5ab99ad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:11.484854 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-840d73e4-068a-4cfc-8f47-9acbd5ab99ad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:11.493247 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-840d73e4-068a-4cfc-8f47-9acbd5ab99ad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1665 microversion: 2.1 time: 0.251150 Oct 19 00:45:11.494065 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 367/748] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:11 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1665 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:45:12.149726 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-9662490c-3a52-4483-a6ba-21c9d1a5b69e tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:12.150418 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-9662490c-3a52-4483-a6ba-21c9d1a5b69e tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:12.164636 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9662490c-3a52-4483-a6ba-21c9d1a5b69e tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:12.165132 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9662490c-3a52-4483-a6ba-21c9d1a5b69e tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:12.165565 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9662490c-3a52-4483-a6ba-21c9d1a5b69e tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:12.166260 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9662490c-3a52-4483-a6ba-21c9d1a5b69e tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:12.166706 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9662490c-3a52-4483-a6ba-21c9d1a5b69e tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:12.181009 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9662490c-3a52-4483-a6ba-21c9d1a5b69e tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:12.227164 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:12.245685 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-01136096-b994-40ea-9cd2-9e0ff8e22cf3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:12.246236 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-01136096-b994-40ea-9cd2-9e0ff8e22cf3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:12.257393 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-01136096-b994-40ea-9cd2-9e0ff8e22cf3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:12.257922 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-01136096-b994-40ea-9cd2-9e0ff8e22cf3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:12.258646 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-01136096-b994-40ea-9cd2-9e0ff8e22cf3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:12.259386 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-01136096-b994-40ea-9cd2-9e0ff8e22cf3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:12.259843 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-01136096-b994-40ea-9cd2-9e0ff8e22cf3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:12.264557 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-01136096-b994-40ea-9cd2-9e0ff8e22cf3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:12.316053 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-01136096-b994-40ea-9cd2-9e0ff8e22cf3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2/os-volume_attachments/4aa8f415-2bce-4c42-9d74-4712c53a9362" status: 200 len: 194 microversion: 2.20 time: 0.386279 Oct 19 00:45:12.319632 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 382/749] 10.222.0.33 () {60 vars in 1454 bytes} [Wed Oct 19 00:45:11 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2/os-volume_attachments/4aa8f415-2bce-4c42-9d74-4712c53a9362 => generated 194 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:45:12.336659 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-3563e061-b293-4281-85bd-5f9083c9dcd7 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:12.337645 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-3563e061-b293-4281-85bd-5f9083c9dcd7 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: bf3b9e96-22bd-44d1-9871-6a454de72bbe] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:12.351441 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3563e061-b293-4281-85bd-5f9083c9dcd7 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:12.353240 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3563e061-b293-4281-85bd-5f9083c9dcd7 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:12.354376 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3563e061-b293-4281-85bd-5f9083c9dcd7 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:12.357772 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3563e061-b293-4281-85bd-5f9083c9dcd7 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:12.358424 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3563e061-b293-4281-85bd-5f9083c9dcd7 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:12.359016 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3563e061-b293-4281-85bd-5f9083c9dcd7 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:12.541267 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-9662490c-3a52-4483-a6ba-21c9d1a5b69e tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:12.554195 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-9662490c-3a52-4483-a6ba-21c9d1a5b69e tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1759 microversion: 2.1 time: 0.408598 Oct 19 00:45:12.556985 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 368/750] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:12 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1759 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:45:12.568648 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-1abcf9e6-e8d5-4893-959d-bef364ced592 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:12.571067 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-1abcf9e6-e8d5-4893-959d-bef364ced592 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:12.582886 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1abcf9e6-e8d5-4893-959d-bef364ced592 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:12.584137 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1abcf9e6-e8d5-4893-959d-bef364ced592 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:12.584854 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1abcf9e6-e8d5-4893-959d-bef364ced592 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:12.585768 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1abcf9e6-e8d5-4893-959d-bef364ced592 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:12.586534 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1abcf9e6-e8d5-4893-959d-bef364ced592 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:12.587153 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1abcf9e6-e8d5-4893-959d-bef364ced592 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:12.625504 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-3563e061-b293-4281-85bd-5f9083c9dcd7 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:12.644644 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-3563e061-b293-4281-85bd-5f9083c9dcd7 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe" status: 200 len: 1367 microversion: 2.1 time: 0.323263 Oct 19 00:45:12.655874 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 383/751] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:12 2022] GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe => generated 1367 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:12.655874 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-179e4850-a30c-4ada-a8cc-30b9f92b697c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:12.655874 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-179e4850-a30c-4ada-a8cc-30b9f92b697c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:12.663508 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-179e4850-a30c-4ada-a8cc-30b9f92b697c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:12.663508 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-179e4850-a30c-4ada-a8cc-30b9f92b697c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:12.663508 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-179e4850-a30c-4ada-a8cc-30b9f92b697c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:12.663508 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-179e4850-a30c-4ada-a8cc-30b9f92b697c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:12.664390 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-179e4850-a30c-4ada-a8cc-30b9f92b697c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:12.664390 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-179e4850-a30c-4ada-a8cc-30b9f92b697c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:12.751874 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.objects.instance [None req-1abcf9e6-e8d5-4893-959d-bef364ced592 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lazy-loading 'services' on Instance uuid 1c74fb45-ef8a-4a88-8126-21c8266fddb2 {{(pid=125531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:45:12.888288 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-1abcf9e6-e8d5-4893-959d-bef364ced592 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2/os-volume_attachments/4aa8f415-2bce-4c42-9d74-4712c53a9362" status: 202 len: 0 microversion: 2.20 time: 0.328366 Oct 19 00:45:12.889194 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 369/752] 10.222.0.33 () {60 vars in 1457 bytes} [Wed Oct 19 00:45:12 2022] DELETE /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2/os-volume_attachments/4aa8f415-2bce-4c42-9d74-4712c53a9362 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:45:12.897886 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-59500596-1740-40a1-bfd4-88bf42bcfe00 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:12.906029 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-59500596-1740-40a1-bfd4-88bf42bcfe00 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:12.919689 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-59500596-1740-40a1-bfd4-88bf42bcfe00 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:12.920489 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-59500596-1740-40a1-bfd4-88bf42bcfe00 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:12.921329 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-59500596-1740-40a1-bfd4-88bf42bcfe00 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:12.923091 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-59500596-1740-40a1-bfd4-88bf42bcfe00 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:12.923737 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-59500596-1740-40a1-bfd4-88bf42bcfe00 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:12.924350 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-59500596-1740-40a1-bfd4-88bf42bcfe00 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:12.977243 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-59500596-1740-40a1-bfd4-88bf42bcfe00 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083490 Oct 19 00:45:12.983530 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 370/753] 10.222.0.33 () {60 vars in 1343 bytes} [Wed Oct 19 00:45:12 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:45:13.118260 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-179e4850-a30c-4ada-a8cc-30b9f92b697c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:13.131190 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-179e4850-a30c-4ada-a8cc-30b9f92b697c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1669 microversion: 2.1 time: 0.483812 Oct 19 00:45:13.132250 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 384/754] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:12 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1669 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:13.670523 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-1c6437f5-503e-446f-8e1f-744815031414 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:13.671144 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-1c6437f5-503e-446f-8e1f-744815031414 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: bf3b9e96-22bd-44d1-9871-6a454de72bbe] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:13.678034 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1c6437f5-503e-446f-8e1f-744815031414 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:13.678578 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1c6437f5-503e-446f-8e1f-744815031414 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:13.679007 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1c6437f5-503e-446f-8e1f-744815031414 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:13.679707 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1c6437f5-503e-446f-8e1f-744815031414 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:13.680197 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1c6437f5-503e-446f-8e1f-744815031414 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:13.680620 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1c6437f5-503e-446f-8e1f-744815031414 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:13.826003 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-1c6437f5-503e-446f-8e1f-744815031414 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:13.828385 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell0:SELECT=2 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:13.836589 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-1c6437f5-503e-446f-8e1f-744815031414 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe" status: 200 len: 1367 microversion: 2.1 time: 0.169654 Oct 19 00:45:13.837157 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 371/755] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:13 2022] GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:13.991832 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-e3625709-3824-4e6b-b440-09415ca2c2cb tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:13.994120 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-e3625709-3824-4e6b-b440-09415ca2c2cb tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:13.997047 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell0:SELECT=2 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:13.997982 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell0:SELECT=10 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:14.003539 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e3625709-3824-4e6b-b440-09415ca2c2cb tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:14.004810 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e3625709-3824-4e6b-b440-09415ca2c2cb tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:14.006080 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e3625709-3824-4e6b-b440-09415ca2c2cb tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:14.007112 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e3625709-3824-4e6b-b440-09415ca2c2cb tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:14.007553 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e3625709-3824-4e6b-b440-09415ca2c2cb tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:14.008070 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e3625709-3824-4e6b-b440-09415ca2c2cb tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:14.043871 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-e3625709-3824-4e6b-b440-09415ca2c2cb tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.057078 Oct 19 00:45:14.049965 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 385/756] 10.222.0.33 () {60 vars in 1343 bytes} [Wed Oct 19 00:45:13 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:14.117036 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-c012d7fc-39c3-4b28-ab44-e933c87d3c81 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:14.117653 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-c012d7fc-39c3-4b28-ab44-e933c87d3c81 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:14.125568 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c012d7fc-39c3-4b28-ab44-e933c87d3c81 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:14.126143 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c012d7fc-39c3-4b28-ab44-e933c87d3c81 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:14.126589 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c012d7fc-39c3-4b28-ab44-e933c87d3c81 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:14.129160 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c012d7fc-39c3-4b28-ab44-e933c87d3c81 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:14.129906 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c012d7fc-39c3-4b28-ab44-e933c87d3c81 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:14.131396 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c012d7fc-39c3-4b28-ab44-e933c87d3c81 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:14.171140 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-c012d7fc-39c3-4b28-ab44-e933c87d3c81 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Going to try to terminate instance {{(pid=125531) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:45:14.283642 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-c012d7fc-39c3-4b28-ab44-e933c87d3c81 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 204 len: 0 microversion: 2.20 time: 0.172113 Oct 19 00:45:14.284765 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 372/757] 10.222.0.33 () {60 vars in 1280 bytes} [Wed Oct 19 00:45:14 2022] DELETE /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 00:45:14.299977 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-b4288582-6b8a-4366-84b0-d3bb638cf349 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:14.300643 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-b4288582-6b8a-4366-84b0-d3bb638cf349 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:14.319322 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b4288582-6b8a-4366-84b0-d3bb638cf349 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:14.319962 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b4288582-6b8a-4366-84b0-d3bb638cf349 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:14.320413 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b4288582-6b8a-4366-84b0-d3bb638cf349 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:14.321254 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b4288582-6b8a-4366-84b0-d3bb638cf349 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:14.321890 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b4288582-6b8a-4366-84b0-d3bb638cf349 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:14.322340 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b4288582-6b8a-4366-84b0-d3bb638cf349 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:14.500841 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-b4288582-6b8a-4366-84b0-d3bb638cf349 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:14.511556 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-b4288582-6b8a-4366-84b0-d3bb638cf349 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:14.513692 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-b4288582-6b8a-4366-84b0-d3bb638cf349 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:14.514980 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-b4288582-6b8a-4366-84b0-d3bb638cf349 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1722 microversion: 2.20 time: 0.222943 Oct 19 00:45:14.528871 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 386/758] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:14 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:14.859261 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-a33e2c73-e502-4b4f-8768-e34eccd965fc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:14.860098 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-a33e2c73-e502-4b4f-8768-e34eccd965fc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: bf3b9e96-22bd-44d1-9871-6a454de72bbe] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:14.867736 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a33e2c73-e502-4b4f-8768-e34eccd965fc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:14.868455 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a33e2c73-e502-4b4f-8768-e34eccd965fc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:14.868904 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a33e2c73-e502-4b4f-8768-e34eccd965fc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:14.869628 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a33e2c73-e502-4b4f-8768-e34eccd965fc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:14.870089 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a33e2c73-e502-4b4f-8768-e34eccd965fc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:14.870519 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a33e2c73-e502-4b4f-8768-e34eccd965fc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:15.161499 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-a33e2c73-e502-4b4f-8768-e34eccd965fc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:15.170610 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-a33e2c73-e502-4b4f-8768-e34eccd965fc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe" status: 200 len: 1367 microversion: 2.1 time: 0.315686 Oct 19 00:45:15.184302 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 373/759] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:14 2022] GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe => generated 1367 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:15.439528 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-12fe0669-305a-41d7-91df-ad7a0edbea66 req-7d9f7ec4-1d16-43bd-983c-233e6adb3a0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf3b9e96-22bd-44d1-9871-6a454de72bbe", "name": "network-vif-plugged", "status": "completed", "tag": "503b0fd3-4b77-41f7-8483-4834ad6947f7"}]} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:15.451794 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-12fe0669-305a-41d7-91df-ad7a0edbea66 req-7d9f7ec4-1d16-43bd-983c-233e6adb3a0e service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:15.452317 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-12fe0669-305a-41d7-91df-ad7a0edbea66 req-7d9f7ec4-1d16-43bd-983c-233e6adb3a0e service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:15.452743 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-12fe0669-305a-41d7-91df-ad7a0edbea66 req-7d9f7ec4-1d16-43bd-983c-233e6adb3a0e service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:15.465371 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.compute.server_external_events [req-12fe0669-305a-41d7-91df-ad7a0edbea66 req-7d9f7ec4-1d16-43bd-983c-233e6adb3a0e service nova] Creating event network-vif-plugged:503b0fd3-4b77-41f7-8483-4834ad6947f7 for instance bf3b9e96-22bd-44d1-9871-6a454de72bbe on hv-cinder-maste Oct 19 00:45:15.470571 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-12fe0669-305a-41d7-91df-ad7a0edbea66 req-7d9f7ec4-1d16-43bd-983c-233e6adb3a0e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036405 Oct 19 00:45:15.471158 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 387/760] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:15.544361 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-e46de9e5-89c6-4b11-820f-b2fc7ebd4ca3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:15.545137 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-e46de9e5-89c6-4b11-820f-b2fc7ebd4ca3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:15.552752 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e46de9e5-89c6-4b11-820f-b2fc7ebd4ca3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:15.553243 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e46de9e5-89c6-4b11-820f-b2fc7ebd4ca3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:15.553677 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e46de9e5-89c6-4b11-820f-b2fc7ebd4ca3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:15.554371 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e46de9e5-89c6-4b11-820f-b2fc7ebd4ca3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:15.555121 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e46de9e5-89c6-4b11-820f-b2fc7ebd4ca3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:15.555613 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e46de9e5-89c6-4b11-820f-b2fc7ebd4ca3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:15.846363 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-e46de9e5-89c6-4b11-820f-b2fc7ebd4ca3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:15.866119 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-e46de9e5-89c6-4b11-820f-b2fc7ebd4ca3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:15.868956 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-e46de9e5-89c6-4b11-820f-b2fc7ebd4ca3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:15.871107 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-e46de9e5-89c6-4b11-820f-b2fc7ebd4ca3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1722 microversion: 2.20 time: 0.332459 Oct 19 00:45:15.872155 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 374/761] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:15 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1722 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:16.198990 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-94bae730-85c7-42ae-b41e-1fe2bd326b9a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:16.200222 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-94bae730-85c7-42ae-b41e-1fe2bd326b9a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: bf3b9e96-22bd-44d1-9871-6a454de72bbe] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:16.213701 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-94bae730-85c7-42ae-b41e-1fe2bd326b9a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:16.214102 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-94bae730-85c7-42ae-b41e-1fe2bd326b9a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:16.216450 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-94bae730-85c7-42ae-b41e-1fe2bd326b9a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:16.217187 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-94bae730-85c7-42ae-b41e-1fe2bd326b9a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:16.217678 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-94bae730-85c7-42ae-b41e-1fe2bd326b9a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:16.218107 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-94bae730-85c7-42ae-b41e-1fe2bd326b9a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:16.377373 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-94bae730-85c7-42ae-b41e-1fe2bd326b9a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:16.385948 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-94bae730-85c7-42ae-b41e-1fe2bd326b9a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe" status: 200 len: 1367 microversion: 2.1 time: 0.195021 Oct 19 00:45:16.386912 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 388/762] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:16 2022] GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:16.900022 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-4434dc9f-38b6-488d-8c62-0f3ec2a7a86c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:16.900588 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-4434dc9f-38b6-488d-8c62-0f3ec2a7a86c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:16.913070 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4434dc9f-38b6-488d-8c62-0f3ec2a7a86c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:16.914672 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4434dc9f-38b6-488d-8c62-0f3ec2a7a86c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:16.917044 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4434dc9f-38b6-488d-8c62-0f3ec2a7a86c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:16.917908 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4434dc9f-38b6-488d-8c62-0f3ec2a7a86c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:16.918994 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4434dc9f-38b6-488d-8c62-0f3ec2a7a86c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:16.920777 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4434dc9f-38b6-488d-8c62-0f3ec2a7a86c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:17.087448 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-4434dc9f-38b6-488d-8c62-0f3ec2a7a86c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:17.102261 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-4434dc9f-38b6-488d-8c62-0f3ec2a7a86c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:17.104745 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-4434dc9f-38b6-488d-8c62-0f3ec2a7a86c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:17.106844 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-4434dc9f-38b6-488d-8c62-0f3ec2a7a86c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1722 microversion: 2.20 time: 0.210930 Oct 19 00:45:17.108732 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 375/763] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:16 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:17.410188 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-884e765b-cb24-4e70-9578-000f81ee93b0 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:17.410852 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-884e765b-cb24-4e70-9578-000f81ee93b0 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: bf3b9e96-22bd-44d1-9871-6a454de72bbe] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:17.423324 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-884e765b-cb24-4e70-9578-000f81ee93b0 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:17.423842 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-884e765b-cb24-4e70-9578-000f81ee93b0 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:17.424352 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-884e765b-cb24-4e70-9578-000f81ee93b0 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:17.436044 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-884e765b-cb24-4e70-9578-000f81ee93b0 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:17.436607 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-884e765b-cb24-4e70-9578-000f81ee93b0 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:17.437390 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-884e765b-cb24-4e70-9578-000f81ee93b0 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:17.769005 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-884e765b-cb24-4e70-9578-000f81ee93b0 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:17.781273 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-884e765b-cb24-4e70-9578-000f81ee93b0 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe" status: 200 len: 1367 microversion: 2.1 time: 0.375143 Oct 19 00:45:17.795891 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 389/764] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:17 2022] GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe => generated 1367 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:18.137700 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-2a9111b2-a993-46e3-88a5-fc7ad51aff46 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:18.138385 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-2a9111b2-a993-46e3-88a5-fc7ad51aff46 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:18.146645 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2a9111b2-a993-46e3-88a5-fc7ad51aff46 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:18.147135 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2a9111b2-a993-46e3-88a5-fc7ad51aff46 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:18.147578 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2a9111b2-a993-46e3-88a5-fc7ad51aff46 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:18.154692 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2a9111b2-a993-46e3-88a5-fc7ad51aff46 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:18.155196 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2a9111b2-a993-46e3-88a5-fc7ad51aff46 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:18.159341 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2a9111b2-a993-46e3-88a5-fc7ad51aff46 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:18.428633 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-2a9111b2-a993-46e3-88a5-fc7ad51aff46 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:18.440005 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-2a9111b2-a993-46e3-88a5-fc7ad51aff46 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:18.442619 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-2a9111b2-a993-46e3-88a5-fc7ad51aff46 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:18.444832 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-2a9111b2-a993-46e3-88a5-fc7ad51aff46 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1722 microversion: 2.20 time: 0.311092 Oct 19 00:45:18.445967 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 376/765] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:18 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1722 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:18.807557 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-a32f218e-21fc-4cdc-8687-380efcee8a49 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:18.811649 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-a32f218e-21fc-4cdc-8687-380efcee8a49 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: bf3b9e96-22bd-44d1-9871-6a454de72bbe] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:18.825005 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a32f218e-21fc-4cdc-8687-380efcee8a49 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:18.833161 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a32f218e-21fc-4cdc-8687-380efcee8a49 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:18.833707 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a32f218e-21fc-4cdc-8687-380efcee8a49 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:18.834722 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a32f218e-21fc-4cdc-8687-380efcee8a49 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:18.835451 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a32f218e-21fc-4cdc-8687-380efcee8a49 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:18.835954 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a32f218e-21fc-4cdc-8687-380efcee8a49 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:19.178739 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-a32f218e-21fc-4cdc-8687-380efcee8a49 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:19.187278 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-a32f218e-21fc-4cdc-8687-380efcee8a49 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe" status: 200 len: 1556 microversion: 2.1 time: 0.384105 Oct 19 00:45:19.188318 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 390/766] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:18 2022] GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe => generated 1556 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:19.212197 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-7c4817e1-af2f-4892-9927-42b84067d143 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:19.212749 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-7c4817e1-af2f-4892-9927-42b84067d143 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: bf3b9e96-22bd-44d1-9871-6a454de72bbe] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:19.219227 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7c4817e1-af2f-4892-9927-42b84067d143 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:19.220535 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7c4817e1-af2f-4892-9927-42b84067d143 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:19.221168 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7c4817e1-af2f-4892-9927-42b84067d143 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:19.222027 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7c4817e1-af2f-4892-9927-42b84067d143 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:19.223425 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7c4817e1-af2f-4892-9927-42b84067d143 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:19.224576 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7c4817e1-af2f-4892-9927-42b84067d143 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:19.317266 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-7c4817e1-af2f-4892-9927-42b84067d143 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109857 Oct 19 00:45:19.317872 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 377/767] 10.222.0.33 () {58 vars in 1275 bytes} [Wed Oct 19 00:45:19 2022] GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:19.479881 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-b72c4cde-7ede-4d1b-beef-c172f39da88e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:19.480755 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-b72c4cde-7ede-4d1b-beef-c172f39da88e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:19.489526 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b72c4cde-7ede-4d1b-beef-c172f39da88e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:19.490419 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b72c4cde-7ede-4d1b-beef-c172f39da88e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:19.490958 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b72c4cde-7ede-4d1b-beef-c172f39da88e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:19.491773 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b72c4cde-7ede-4d1b-beef-c172f39da88e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:19.492451 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b72c4cde-7ede-4d1b-beef-c172f39da88e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:19.492972 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b72c4cde-7ede-4d1b-beef-c172f39da88e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:19.588628 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-b72c4cde-7ede-4d1b-beef-c172f39da88e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:19.598482 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-b72c4cde-7ede-4d1b-beef-c172f39da88e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:19.600153 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-b72c4cde-7ede-4d1b-beef-c172f39da88e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:19.601362 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-b72c4cde-7ede-4d1b-beef-c172f39da88e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1654 microversion: 2.20 time: 0.127233 Oct 19 00:45:19.601927 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 391/768] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:19 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1654 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:20.376565 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-95627a27-311a-4aa6-b0a0-0e46ee034656 req-03e68c71-8eaa-4603-82be-036898039ec0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c74fb45-ef8a-4a88-8126-21c8266fddb2", "name": "network-vif-deleted", "tag": "7926b647-0ec9-46fb-9fed-f33f2ff9fbcf"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:20.391971 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-95627a27-311a-4aa6-b0a0-0e46ee034656 req-03e68c71-8eaa-4603-82be-036898039ec0 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:20.396135 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-95627a27-311a-4aa6-b0a0-0e46ee034656 req-03e68c71-8eaa-4603-82be-036898039ec0 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:20.397102 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-95627a27-311a-4aa6-b0a0-0e46ee034656 req-03e68c71-8eaa-4603-82be-036898039ec0 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:20.421686 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-95627a27-311a-4aa6-b0a0-0e46ee034656 req-03e68c71-8eaa-4603-82be-036898039ec0 service nova] Creating event network-vif-deleted:7926b647-0ec9-46fb-9fed-f33f2ff9fbcf for instance 1c74fb45-ef8a-4a88-8126-21c8266fddb2 on hv-cinder-maste Oct 19 00:45:20.437965 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-95627a27-311a-4aa6-b0a0-0e46ee034656 req-03e68c71-8eaa-4603-82be-036898039ec0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.478261 Oct 19 00:45:20.438963 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 378/769] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:45:20.532913 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-af7849e9-822e-4262-ba56-12cd1a787a48 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Action: 'create', calling method: .version_select at 0x7f81f0f368b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-161843090", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL5GfNfM1V4mcr2wsdZhg1cTmhYSNNULIaoFG8+smxmZdbW0fFjTCRzNQugSNYgOGpnEBwNLW3BMdsrrEUbnPzEyX6w2d75Di/hvo0hao383KY4mLlKoVOzwtdeYlkIJQ=="}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:20.550640 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.quota [None req-af7849e9-822e-4262-ba56-12cd1a787a48 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Getting quotas for project a98f43c385ec4522b38cc84d00bef279. Resources: {'key_pairs'} {{(pid=125532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:45:20.555464 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.quota [None req-af7849e9-822e-4262-ba56-12cd1a787a48 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Getting quotas for user a3fe41c82b4844f8a4d38bd83206215a and project a98f43c385ec4522b38cc84d00bef279. Resources: {'key_pairs'} {{(pid=125532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:45:20.584640 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-af7849e9-822e-4262-ba56-12cd1a787a48 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.218221 Oct 19 00:45:20.585918 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 392/770] 10.222.0.33 () {60 vars in 1159 bytes} [Wed Oct 19 00:45:20 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:45:20.629861 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-340b1a48-14ba-4d17-b002-4e0aacbc2202 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:20.630642 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-340b1a48-14ba-4d17-b002-4e0aacbc2202 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:20.638284 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-340b1a48-14ba-4d17-b002-4e0aacbc2202 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:20.639014 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-340b1a48-14ba-4d17-b002-4e0aacbc2202 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:20.639460 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-340b1a48-14ba-4d17-b002-4e0aacbc2202 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:20.640208 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-340b1a48-14ba-4d17-b002-4e0aacbc2202 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:20.640829 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-340b1a48-14ba-4d17-b002-4e0aacbc2202 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:20.641560 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-340b1a48-14ba-4d17-b002-4e0aacbc2202 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:20.683806 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-340b1a48-14ba-4d17-b002-4e0aacbc2202 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:20.685063 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-340b1a48-14ba-4d17-b002-4e0aacbc2202 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:20.685652 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-340b1a48-14ba-4d17-b002-4e0aacbc2202 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:20.686339 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.objects.instance [None req-340b1a48-14ba-4d17-b002-4e0aacbc2202 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lazy-loading 'fault' on Instance uuid 1c74fb45-ef8a-4a88-8126-21c8266fddb2 {{(pid=125531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:45:20.755084 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-340b1a48-14ba-4d17-b002-4e0aacbc2202 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:20.772512 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-340b1a48-14ba-4d17-b002-4e0aacbc2202 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:20.774487 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-340b1a48-14ba-4d17-b002-4e0aacbc2202 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:20.778892 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-340b1a48-14ba-4d17-b002-4e0aacbc2202 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 200 len: 1371 microversion: 2.20 time: 0.152173 Oct 19 00:45:20.781242 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 379/771] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:20 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:21.199890 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-ac3f3f3a-0f2d-4dd1-aec7-4e42504c22df req-162c1c4f-d5df-4b50-906e-9e486e775e0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf3b9e96-22bd-44d1-9871-6a454de72bbe", "tag": "503b0fd3-4b77-41f7-8483-4834ad6947f7"}]} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:21.227664 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-ac3f3f3a-0f2d-4dd1-aec7-4e42504c22df req-162c1c4f-d5df-4b50-906e-9e486e775e0b service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:21.228559 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-ac3f3f3a-0f2d-4dd1-aec7-4e42504c22df req-162c1c4f-d5df-4b50-906e-9e486e775e0b service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:21.229445 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-ac3f3f3a-0f2d-4dd1-aec7-4e42504c22df req-162c1c4f-d5df-4b50-906e-9e486e775e0b service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:21.243056 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.compute.server_external_events [req-ac3f3f3a-0f2d-4dd1-aec7-4e42504c22df req-162c1c4f-d5df-4b50-906e-9e486e775e0b service nova] Creating event network-changed:503b0fd3-4b77-41f7-8483-4834ad6947f7 for instance bf3b9e96-22bd-44d1-9871-6a454de72bbe on hv-cinder-maste Oct 19 00:45:21.250155 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-ac3f3f3a-0f2d-4dd1-aec7-4e42504c22df req-162c1c4f-d5df-4b50-906e-9e486e775e0b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131371 Oct 19 00:45:21.251493 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 393/772] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:21.810369 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-b189e517-3631-4bcf-9409-ff6e33c17d79 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:21.811530 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-b189e517-3631-4bcf-9409-ff6e33c17d79 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:21.830299 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b189e517-3631-4bcf-9409-ff6e33c17d79 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:21.833698 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b189e517-3631-4bcf-9409-ff6e33c17d79 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:21.841161 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b189e517-3631-4bcf-9409-ff6e33c17d79 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:21.845639 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b189e517-3631-4bcf-9409-ff6e33c17d79 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:21.846154 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b189e517-3631-4bcf-9409-ff6e33c17d79 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:21.849456 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b189e517-3631-4bcf-9409-ff6e33c17d79 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:21.890186 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.wsgi [None req-b189e517-3631-4bcf-9409-ff6e33c17d79 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] HTTP exception thrown: Instance 1c74fb45-ef8a-4a88-8126-21c8266fddb2 could not be found. Oct 19 00:45:21.893534 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-b189e517-3631-4bcf-9409-ff6e33c17d79 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Request method failure captured: Oct 19 00:45:21.893534 dv-cinder-master-3-smb devstack@n-api.service[125531]: request: GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 HTTP/1.1 Oct 19 00:45:21.893534 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept: application/json Oct 19 00:45:21.893534 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept-Encoding: identity Oct 19 00:45:21.893534 dv-cinder-master-3-smb devstack@n-api.service[125531]: Connection: close Oct 19 00:45:21.893534 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Length: 0 Oct 19 00:45:21.893534 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Type: application/json Oct 19 00:45:21.893534 dv-cinder-master-3-smb devstack@n-api.service[125531]: Host: 10.222.0.33 Oct 19 00:45:21.893534 dv-cinder-master-3-smb devstack@n-api.service[125531]: Openstack-System-Scope: None Oct 19 00:45:21.893534 dv-cinder-master-3-smb devstack@n-api.service[125531]: User-Agent: python-urllib3/1.26.12 Oct 19 00:45:21.893534 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Auth-Token: gAAAAABjT0dURaQ0HkRLJEsGfzC_hRt4QN5ysEIaY_BdQncL37G8-e-M3ZjfrgebU4tcOIRdKUHJ-8z0aMZ640IHN49nGivJqqNyX0ZANulCJEroSNvpy7R_0fS2-vNh5ZgaMp1tnHwZD8YVTbC5bIUu683iJQuGIijDZuo9O89CoiTmfOhMdZY Oct 19 00:45:21.893534 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Id: None Oct 19 00:45:21.893534 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Name: None Oct 19 00:45:21.893534 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Identity-Status: Confirmed Oct 19 00:45:21.893534 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Is-Admin-Project: True Oct 19 00:45:21.893534 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 00:45:21.893534 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Id: default Oct 19 00:45:21.893534 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Name: Default Oct 19 00:45:21.893534 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Id: 5e171056a4354ca695c18f115bfb750f Oct 19 00:45:21.893534 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-150806215 Oct 19 00:45:21.893534 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Role: member,reader Oct 19 00:45:21.893534 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Roles: member,reader Oct 19 00:45:21.896562 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5e171056a4354ca695c18f115bfb750f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5e171056a4354ca695c18f115bfb750f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5e171056a4354ca695c18f115bfb750f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5e171056a4354ca695c18f115bfb750f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:45:21.896562 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant: tempest-AttachVolumeShelveTestJSON-150806215 Oct 19 00:45:21.896562 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Id: 5e171056a4354ca695c18f115bfb750f Oct 19 00:45:21.896562 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-150806215 Oct 19 00:45:21.896562 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User: tempest-AttachVolumeShelveTestJSON-150806215-project Oct 19 00:45:21.896562 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Id: default Oct 19 00:45:21.896562 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Name: Default Oct 19 00:45:21.896562 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Id: 59bad833caf84817b8553d699b2fa04f Oct 19 00:45:21.896562 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Name: tempest-AttachVolumeShelveTestJSON-150806215-project Oct 19 00:45:21.896562 dv-cinder-master-3-smb devstack@n-api.service[125531]: method: > Oct 19 00:45:21.896562 dv-cinder-master-3-smb devstack@n-api.service[125531]: exception: Instance 1c74fb45-ef8a-4a88-8126-21c8266fddb2 could not be found. Oct 19 00:45:21.896562 dv-cinder-master-3-smb devstack@n-api.service[125531]: action_args: {'id': '1c74fb45-ef8a-4a88-8126-21c8266fddb2'} Oct 19 00:45:21.897646 dv-cinder-master-3-smb devstack@n-api.service[125531]: {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:45:21.897646 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:21.897646 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:45:21.897646 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:45:21.897646 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:45:21.897646 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:45:21.897646 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:45:21.897646 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:45:21.897646 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:45:21.897646 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:45:21.897646 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c74fb45-ef8a-4a88-8126-21c8266fddb2 could not be found. Oct 19 00:45:21.897646 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:45:21.897646 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:45:21.897646 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:45:21.897646 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:21.897646 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:45:21.897646 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:45:21.897646 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:45:21.897646 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:45:21.897646 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:45:21.899465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:45:21.899465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:45:21.899465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:45:21.899465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:45:21.899465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:45:21.899465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:45:21.899465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:45:21.899465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c74fb45-ef8a-4a88-8126-21c8266fddb2 could not be found. Oct 19 00:45:21.899465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:45:21.899465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:45:21.899465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:45:21.899465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:21.899465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:45:21.899465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:45:21.899465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:45:21.899465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:45:21.899465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c74fb45-ef8a-4a88-8126-21c8266fddb2 could not be found. Oct 19 00:45:21.899465 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:45:21.904849 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-b189e517-3631-4bcf-9409-ff6e33c17d79 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Returning 404 to user: Instance 1c74fb45-ef8a-4a88-8126-21c8266fddb2 could not be found. {{(pid=125531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:45:21.907898 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-b189e517-3631-4bcf-9409-ff6e33c17d79 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 404 len: 111 microversion: 2.20 time: 0.102450 Oct 19 00:45:21.909552 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 380/773] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:21 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:45:21.918364 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-6591d533-8b16-42b2-a611-6c940d1f60d6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '.version_select at 0x7f81f0efd430>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:21.961365 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-6591d533-8b16-42b2-a611-6c940d1f60d6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1836100858" status: 204 len: 0 microversion: 2.20 time: 0.047136 Oct 19 00:45:21.962167 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 394/774] 10.222.0.33 () {60 vars in 1262 bytes} [Wed Oct 19 00:45:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1836100858 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 00:45:22.880528 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-1f8319ba-a202-4513-be42-b46e60e1ec1e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Action: 'create', calling method: .version_select at 0x7f81f1063e50>, body: {"keypair": {"name": "tempest-keypair-796050227", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIK3bn8NHAZygO9P5LvBSS6AsVOAbFee7s6ZKhhPJNl0u+sJ1bw+pu3ewVZa/lpG7+Du9zaLqD4h1X3JuD8MsnAyrCpCLk1eg7/ZobF/a9m56nfMTOQkqRhPtQjDuL6YlA=="}} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:22.917427 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.quota [None req-1f8319ba-a202-4513-be42-b46e60e1ec1e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Getting quotas for project 5e171056a4354ca695c18f115bfb750f. Resources: {'key_pairs'} {{(pid=125531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:45:22.926960 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.quota [None req-1f8319ba-a202-4513-be42-b46e60e1ec1e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Getting quotas for user 59bad833caf84817b8553d699b2fa04f and project 5e171056a4354ca695c18f115bfb750f. Resources: {'key_pairs'} {{(pid=125531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:45:22.981898 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-1f8319ba-a202-4513-be42-b46e60e1ec1e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.106079 Oct 19 00:45:22.982817 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 381/775] 10.222.0.33 () {62 vars in 1200 bytes} [Wed Oct 19 00:45:22 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 108 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 19 00:45:24.388726 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-de2275db-4042-449f-8366-d188c180f883 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1586581062", "imageRef": "d1f4abc9-3bb9-4343-9a05-53d758070c9d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f6e68d02-c832-4157-afd5-6714e9e0f718"}], "security_groups": [{"name": "tempest-securitygroup--1447208187"}], "key_name": "tempest-keypair-796050227", "user_data": "}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:24.518499 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.network.neutron [None req-de2275db-4042-449f-8366-d188c180f883 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] validate_networks() for [('f6e68d02-c832-4157-afd5-6714e9e0f718', None, None, None, None, None)] {{(pid=125532) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:45:24.906264 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-de2275db-4042-449f-8366-d188c180f883 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Flavor limits 0:0:0 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:45:24.906896 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-de2275db-4042-449f-8366-d188c180f883 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Image limits 0:0:0 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:45:24.907367 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-de2275db-4042-449f-8366-d188c180f883 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Flavor pref 0:0:0 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:45:24.907773 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-de2275db-4042-449f-8366-d188c180f883 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Image pref 0:0:0 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:45:24.908280 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-de2275db-4042-449f-8366-d188c180f883 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:45:24.919263 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-de2275db-4042-449f-8366-d188c180f883 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:24.920119 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-de2275db-4042-449f-8366-d188c180f883 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:24.920740 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-de2275db-4042-449f-8366-d188c180f883 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:24.921667 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-de2275db-4042-449f-8366-d188c180f883 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:24.922283 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-de2275db-4042-449f-8366-d188c180f883 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:24.922861 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-de2275db-4042-449f-8366-d188c180f883 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:24.943631 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.quota [None req-de2275db-4042-449f-8366-d188c180f883 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Getting quotas for project 5e171056a4354ca695c18f115bfb750f. Resources: {'instances', 'cores', 'ram'} {{(pid=125532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:45:24.947739 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.quota [None req-de2275db-4042-449f-8366-d188c180f883 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Getting quotas for user 59bad833caf84817b8553d699b2fa04f and project 5e171056a4354ca695c18f115bfb750f. Resources: {'instances', 'cores', 'ram'} {{(pid=125532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:45:24.960676 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-de2275db-4042-449f-8366-d188c180f883 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Going to run 1 instances... {{(pid=125532) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:45:24.963153 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-de2275db-4042-449f-8366-d188c180f883 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1f4abc9-3bb9-4343-9a05-53d758070c9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125532) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:45:25.018073 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-de2275db-4042-449f-8366-d188c180f883 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.634414 Oct 19 00:45:25.018961 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 395/776] 10.222.0.33 () {62 vars in 1188 bytes} [Wed Oct 19 00:45:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 00:45:25.033049 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-0c17593d-efeb-44dd-9c8e-9a368e264067 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:25.033910 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-0c17593d-efeb-44dd-9c8e-9a368e264067 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:25.121972 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-0c17593d-efeb-44dd-9c8e-9a368e264067 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:25.133646 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-0c17593d-efeb-44dd-9c8e-9a368e264067 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:25.135232 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-0c17593d-efeb-44dd-9c8e-9a368e264067 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:25.136520 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-0c17593d-efeb-44dd-9c8e-9a368e264067 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1281 microversion: 2.20 time: 0.109830 Oct 19 00:45:25.137165 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 382/777] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:25 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1281 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:45:26.163946 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-1cfbca56-8fcb-4471-a820-19e8dd599ff5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:26.164541 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-1cfbca56-8fcb-4471-a820-19e8dd599ff5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:26.171446 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1cfbca56-8fcb-4471-a820-19e8dd599ff5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:26.171988 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1cfbca56-8fcb-4471-a820-19e8dd599ff5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:26.172421 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1cfbca56-8fcb-4471-a820-19e8dd599ff5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:26.173114 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1cfbca56-8fcb-4471-a820-19e8dd599ff5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:26.173566 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1cfbca56-8fcb-4471-a820-19e8dd599ff5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:26.173982 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1cfbca56-8fcb-4471-a820-19e8dd599ff5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:26.241977 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-1cfbca56-8fcb-4471-a820-19e8dd599ff5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:26.250110 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-1cfbca56-8fcb-4471-a820-19e8dd599ff5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:26.251534 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-1cfbca56-8fcb-4471-a820-19e8dd599ff5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:26.252652 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-1cfbca56-8fcb-4471-a820-19e8dd599ff5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1333 microversion: 2.20 time: 0.094363 Oct 19 00:45:26.253209 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 396/778] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:26 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1333 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:27.279240 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-4c1357ee-ac0c-4eaa-9038-0c510e8645ed tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:27.279914 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-4c1357ee-ac0c-4eaa-9038-0c510e8645ed tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:27.286850 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4c1357ee-ac0c-4eaa-9038-0c510e8645ed tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:27.287374 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4c1357ee-ac0c-4eaa-9038-0c510e8645ed tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:27.287895 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4c1357ee-ac0c-4eaa-9038-0c510e8645ed tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:27.288620 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4c1357ee-ac0c-4eaa-9038-0c510e8645ed tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:27.289077 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4c1357ee-ac0c-4eaa-9038-0c510e8645ed tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:27.289515 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4c1357ee-ac0c-4eaa-9038-0c510e8645ed tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:27.453706 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-4c1357ee-ac0c-4eaa-9038-0c510e8645ed tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:27.466295 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-4c1357ee-ac0c-4eaa-9038-0c510e8645ed tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:27.467753 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-4c1357ee-ac0c-4eaa-9038-0c510e8645ed tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:27.469021 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-4c1357ee-ac0c-4eaa-9038-0c510e8645ed tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1407 microversion: 2.20 time: 0.194344 Oct 19 00:45:27.469586 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 383/779] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:27 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:28.348569 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-704427c3-59c6-43ab-9bdc-c41ceb3bd052 req-a4e7dd17-24e7-4e81-8025-2bf6abbb7514 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a48c163-1acb-4ff4-8f2e-b6b529707da4", "tag": "3fc16ed1-ad15-4f2c-8cb0-7877e83842ab"}]} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:28.364261 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-704427c3-59c6-43ab-9bdc-c41ceb3bd052 req-a4e7dd17-24e7-4e81-8025-2bf6abbb7514 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:28.364783 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-704427c3-59c6-43ab-9bdc-c41ceb3bd052 req-a4e7dd17-24e7-4e81-8025-2bf6abbb7514 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:28.365538 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-704427c3-59c6-43ab-9bdc-c41ceb3bd052 req-a4e7dd17-24e7-4e81-8025-2bf6abbb7514 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:28.377280 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.compute.server_external_events [req-704427c3-59c6-43ab-9bdc-c41ceb3bd052 req-a4e7dd17-24e7-4e81-8025-2bf6abbb7514 service nova] Creating event network-changed:3fc16ed1-ad15-4f2c-8cb0-7877e83842ab for instance 7a48c163-1acb-4ff4-8f2e-b6b529707da4 on hv-cinder-maste Oct 19 00:45:28.382873 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-704427c3-59c6-43ab-9bdc-c41ceb3bd052 req-a4e7dd17-24e7-4e81-8025-2bf6abbb7514 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039360 Oct 19 00:45:28.384622 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 397/780] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:28.495093 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-99e74079-1a7f-4394-a512-d619b6478ea2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:28.495728 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-99e74079-1a7f-4394-a512-d619b6478ea2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:28.502891 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-99e74079-1a7f-4394-a512-d619b6478ea2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:28.503375 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-99e74079-1a7f-4394-a512-d619b6478ea2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:28.504524 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-99e74079-1a7f-4394-a512-d619b6478ea2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:28.505841 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-99e74079-1a7f-4394-a512-d619b6478ea2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:28.506296 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-99e74079-1a7f-4394-a512-d619b6478ea2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:28.506722 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-99e74079-1a7f-4394-a512-d619b6478ea2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:28.640751 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-99e74079-1a7f-4394-a512-d619b6478ea2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:28.649718 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-99e74079-1a7f-4394-a512-d619b6478ea2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:28.651149 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-99e74079-1a7f-4394-a512-d619b6478ea2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:28.652284 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-99e74079-1a7f-4394-a512-d619b6478ea2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1407 microversion: 2.20 time: 0.161297 Oct 19 00:45:28.652841 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 384/781] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:28 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:29.678951 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-5019ba32-88fc-4f9c-aab1-34c0d430766b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:29.679664 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-5019ba32-88fc-4f9c-aab1-34c0d430766b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:29.686929 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5019ba32-88fc-4f9c-aab1-34c0d430766b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:29.687446 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5019ba32-88fc-4f9c-aab1-34c0d430766b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:29.687971 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5019ba32-88fc-4f9c-aab1-34c0d430766b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:29.688757 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5019ba32-88fc-4f9c-aab1-34c0d430766b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:29.689257 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5019ba32-88fc-4f9c-aab1-34c0d430766b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:29.689725 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5019ba32-88fc-4f9c-aab1-34c0d430766b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:29.705223 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell1:SELECT=100 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:29.827768 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-5019ba32-88fc-4f9c-aab1-34c0d430766b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:29.837627 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-5019ba32-88fc-4f9c-aab1-34c0d430766b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:29.839234 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-5019ba32-88fc-4f9c-aab1-34c0d430766b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:29.840501 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-5019ba32-88fc-4f9c-aab1-34c0d430766b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1407 microversion: 2.20 time: 0.166295 Oct 19 00:45:29.841060 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 398/782] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:29 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:30.866655 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-3d6e2791-d36c-4fce-9333-d1b99e02d4f6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:30.867324 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-3d6e2791-d36c-4fce-9333-d1b99e02d4f6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:30.874655 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3d6e2791-d36c-4fce-9333-d1b99e02d4f6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:30.875138 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3d6e2791-d36c-4fce-9333-d1b99e02d4f6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:30.875655 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3d6e2791-d36c-4fce-9333-d1b99e02d4f6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:30.876480 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3d6e2791-d36c-4fce-9333-d1b99e02d4f6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:30.877210 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3d6e2791-d36c-4fce-9333-d1b99e02d4f6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:30.877876 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3d6e2791-d36c-4fce-9333-d1b99e02d4f6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:31.011585 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-3d6e2791-d36c-4fce-9333-d1b99e02d4f6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:31.020285 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-3d6e2791-d36c-4fce-9333-d1b99e02d4f6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:31.021907 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-3d6e2791-d36c-4fce-9333-d1b99e02d4f6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:31.023008 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-3d6e2791-d36c-4fce-9333-d1b99e02d4f6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1407 microversion: 2.20 time: 0.161828 Oct 19 00:45:31.023554 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 385/783] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:30 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:32.048289 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-7d4d99d9-a7e6-4eaa-bb32-59d9a86fb05d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:32.048909 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-7d4d99d9-a7e6-4eaa-bb32-59d9a86fb05d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:32.056363 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7d4d99d9-a7e6-4eaa-bb32-59d9a86fb05d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:32.056847 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7d4d99d9-a7e6-4eaa-bb32-59d9a86fb05d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:32.057286 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7d4d99d9-a7e6-4eaa-bb32-59d9a86fb05d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:32.057982 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7d4d99d9-a7e6-4eaa-bb32-59d9a86fb05d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:32.058438 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7d4d99d9-a7e6-4eaa-bb32-59d9a86fb05d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:32.058861 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7d4d99d9-a7e6-4eaa-bb32-59d9a86fb05d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:32.271515 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-7d4d99d9-a7e6-4eaa-bb32-59d9a86fb05d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:32.280045 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-7d4d99d9-a7e6-4eaa-bb32-59d9a86fb05d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:32.281475 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-7d4d99d9-a7e6-4eaa-bb32-59d9a86fb05d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:32.282586 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-7d4d99d9-a7e6-4eaa-bb32-59d9a86fb05d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1407 microversion: 2.20 time: 0.238698 Oct 19 00:45:32.283149 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 399/784] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:32 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:33.308160 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-38fab433-574d-4aa6-be6d-5bc35837ee6b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:33.308752 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-38fab433-574d-4aa6-be6d-5bc35837ee6b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:33.311133 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:33.316552 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-38fab433-574d-4aa6-be6d-5bc35837ee6b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:33.317043 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-38fab433-574d-4aa6-be6d-5bc35837ee6b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:33.317477 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-38fab433-574d-4aa6-be6d-5bc35837ee6b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:33.318179 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-38fab433-574d-4aa6-be6d-5bc35837ee6b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:33.318633 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-38fab433-574d-4aa6-be6d-5bc35837ee6b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:33.319055 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-38fab433-574d-4aa6-be6d-5bc35837ee6b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:33.324235 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:33.469705 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-38fab433-574d-4aa6-be6d-5bc35837ee6b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:33.505048 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-38fab433-574d-4aa6-be6d-5bc35837ee6b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:33.506518 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-38fab433-574d-4aa6-be6d-5bc35837ee6b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:33.507677 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-38fab433-574d-4aa6-be6d-5bc35837ee6b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1407 microversion: 2.20 time: 0.203542 Oct 19 00:45:33.509195 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 386/785] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:33 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:34.532991 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-3cbc5a8f-41a0-4ba0-993e-59040fc4e805 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:34.533669 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-3cbc5a8f-41a0-4ba0-993e-59040fc4e805 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:34.541136 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3cbc5a8f-41a0-4ba0-993e-59040fc4e805 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:34.541608 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3cbc5a8f-41a0-4ba0-993e-59040fc4e805 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:34.542036 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3cbc5a8f-41a0-4ba0-993e-59040fc4e805 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:34.542923 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3cbc5a8f-41a0-4ba0-993e-59040fc4e805 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:34.543384 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3cbc5a8f-41a0-4ba0-993e-59040fc4e805 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:34.543793 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3cbc5a8f-41a0-4ba0-993e-59040fc4e805 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:34.679490 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-3cbc5a8f-41a0-4ba0-993e-59040fc4e805 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:34.687541 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-3cbc5a8f-41a0-4ba0-993e-59040fc4e805 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:34.689033 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-3cbc5a8f-41a0-4ba0-993e-59040fc4e805 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:34.690136 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-3cbc5a8f-41a0-4ba0-993e-59040fc4e805 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1407 microversion: 2.20 time: 0.160977 Oct 19 00:45:34.690692 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 400/786] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:34 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:35.133641 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell0:SELECT=6 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:35.193712 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-b6a93ac1-e410-4fb8-91d5-11e92e4b4c61 req-befd6991-64db-47f9-9fc7-c9d9124c7fce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a48c163-1acb-4ff4-8f2e-b6b529707da4", "name": "network-vif-plugged", "status": "completed", "tag": "3fc16ed1-ad15-4f2c-8cb0-7877e83842ab"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:35.203501 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-b6a93ac1-e410-4fb8-91d5-11e92e4b4c61 req-befd6991-64db-47f9-9fc7-c9d9124c7fce service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:35.203623 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-b6a93ac1-e410-4fb8-91d5-11e92e4b4c61 req-befd6991-64db-47f9-9fc7-c9d9124c7fce service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:35.204064 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-b6a93ac1-e410-4fb8-91d5-11e92e4b4c61 req-befd6991-64db-47f9-9fc7-c9d9124c7fce service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:35.215654 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-b6a93ac1-e410-4fb8-91d5-11e92e4b4c61 req-befd6991-64db-47f9-9fc7-c9d9124c7fce service nova] Creating event network-vif-plugged:3fc16ed1-ad15-4f2c-8cb0-7877e83842ab for instance 7a48c163-1acb-4ff4-8f2e-b6b529707da4 on hv-cinder-maste Oct 19 00:45:35.220599 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-b6a93ac1-e410-4fb8-91d5-11e92e4b4c61 req-befd6991-64db-47f9-9fc7-c9d9124c7fce service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092252 Oct 19 00:45:35.221249 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 387/787] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:35.436331 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-d7189681-1ed3-4d7d-94bc-6e88ed59c951 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:35.436816 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-d7189681-1ed3-4d7d-94bc-6e88ed59c951 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:35.439863 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell0:SELECT=2 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:35.440827 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell0:SELECT=10 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:35.446072 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d7189681-1ed3-4d7d-94bc-6e88ed59c951 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:35.446594 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d7189681-1ed3-4d7d-94bc-6e88ed59c951 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:35.446990 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d7189681-1ed3-4d7d-94bc-6e88ed59c951 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:35.447690 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d7189681-1ed3-4d7d-94bc-6e88ed59c951 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:35.448264 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d7189681-1ed3-4d7d-94bc-6e88ed59c951 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:35.448675 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d7189681-1ed3-4d7d-94bc-6e88ed59c951 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:35.571546 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.objects.instance [None req-d7189681-1ed3-4d7d-94bc-6e88ed59c951 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lazy-loading 'services' on Instance uuid 4b862704-38e5-4ea8-9fa2-741591535b6f {{(pid=125532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:45:35.682661 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-d7189681-1ed3-4d7d-94bc-6e88ed59c951 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f/os-volume_attachments/e5c90d3e-3b9a-44e2-a1b5-5a7829829712" status: 202 len: 0 microversion: 2.1 time: 0.250138 Oct 19 00:45:35.683251 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 401/788] 10.222.0.33 () {58 vars in 1416 bytes} [Wed Oct 19 00:45:35 2022] DELETE /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f/os-volume_attachments/e5c90d3e-3b9a-44e2-a1b5-5a7829829712 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:45:35.692697 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-ff73153e-e93b-4ade-8025-882597a8db47 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:35.695043 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-ff73153e-e93b-4ade-8025-882597a8db47 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:35.701397 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ff73153e-e93b-4ade-8025-882597a8db47 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:35.701895 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ff73153e-e93b-4ade-8025-882597a8db47 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:35.702430 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ff73153e-e93b-4ade-8025-882597a8db47 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:35.703052 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ff73153e-e93b-4ade-8025-882597a8db47 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:35.703496 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ff73153e-e93b-4ade-8025-882597a8db47 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:35.703938 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ff73153e-e93b-4ade-8025-882597a8db47 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:35.716231 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-98d0f598-b187-4a98-85ba-e21c4f8191c5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:35.716924 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-98d0f598-b187-4a98-85ba-e21c4f8191c5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:35.723767 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-98d0f598-b187-4a98-85ba-e21c4f8191c5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:35.724494 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-98d0f598-b187-4a98-85ba-e21c4f8191c5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:35.725192 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-98d0f598-b187-4a98-85ba-e21c4f8191c5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:35.726058 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-98d0f598-b187-4a98-85ba-e21c4f8191c5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:35.726708 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-98d0f598-b187-4a98-85ba-e21c4f8191c5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:35.727274 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-98d0f598-b187-4a98-85ba-e21c4f8191c5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:35.735953 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-ff73153e-e93b-4ade-8025-882597a8db47 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047906 Oct 19 00:45:35.741873 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 388/789] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Oct 19 00:45:35 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:35.893315 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-98d0f598-b187-4a98-85ba-e21c4f8191c5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:35.901999 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-98d0f598-b187-4a98-85ba-e21c4f8191c5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:35.903490 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-98d0f598-b187-4a98-85ba-e21c4f8191c5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:35.904749 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-98d0f598-b187-4a98-85ba-e21c4f8191c5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1407 microversion: 2.20 time: 0.192683 Oct 19 00:45:35.905569 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 402/790] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:35 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:45:36.749270 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-fa523dd3-f434-4bba-a7a1-2375a3a37875 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:36.751399 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-fa523dd3-f434-4bba-a7a1-2375a3a37875 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:36.758608 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fa523dd3-f434-4bba-a7a1-2375a3a37875 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:36.759093 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fa523dd3-f434-4bba-a7a1-2375a3a37875 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:36.759528 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fa523dd3-f434-4bba-a7a1-2375a3a37875 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:36.760254 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fa523dd3-f434-4bba-a7a1-2375a3a37875 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:36.760713 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fa523dd3-f434-4bba-a7a1-2375a3a37875 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:36.761141 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fa523dd3-f434-4bba-a7a1-2375a3a37875 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:36.790678 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-fa523dd3-f434-4bba-a7a1-2375a3a37875 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045372 Oct 19 00:45:36.791220 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 389/791] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Oct 19 00:45:36 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:36.935570 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-f950ef2d-2d46-4f4a-a49a-8feb78a04c55 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:36.936174 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-f950ef2d-2d46-4f4a-a49a-8feb78a04c55 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:36.943380 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f950ef2d-2d46-4f4a-a49a-8feb78a04c55 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:36.943869 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f950ef2d-2d46-4f4a-a49a-8feb78a04c55 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:36.944331 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f950ef2d-2d46-4f4a-a49a-8feb78a04c55 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:36.945020 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f950ef2d-2d46-4f4a-a49a-8feb78a04c55 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:36.945470 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f950ef2d-2d46-4f4a-a49a-8feb78a04c55 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:36.945892 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f950ef2d-2d46-4f4a-a49a-8feb78a04c55 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:37.074283 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-f950ef2d-2d46-4f4a-a49a-8feb78a04c55 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:37.083045 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-f950ef2d-2d46-4f4a-a49a-8feb78a04c55 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:37.084524 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-f950ef2d-2d46-4f4a-a49a-8feb78a04c55 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:37.085626 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-f950ef2d-2d46-4f4a-a49a-8feb78a04c55 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1407 microversion: 2.20 time: 0.154041 Oct 19 00:45:37.086182 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 403/792] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:36 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:37.803088 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-a081bf27-722d-478e-ab20-2009ad21b2ab tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:37.805314 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-a081bf27-722d-478e-ab20-2009ad21b2ab tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:37.811672 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a081bf27-722d-478e-ab20-2009ad21b2ab tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:37.812199 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a081bf27-722d-478e-ab20-2009ad21b2ab tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:37.812643 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a081bf27-722d-478e-ab20-2009ad21b2ab tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:37.813342 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a081bf27-722d-478e-ab20-2009ad21b2ab tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:37.813799 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a081bf27-722d-478e-ab20-2009ad21b2ab tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:37.814232 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a081bf27-722d-478e-ab20-2009ad21b2ab tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:37.846414 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-a081bf27-722d-478e-ab20-2009ad21b2ab tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047756 Oct 19 00:45:37.846979 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 390/793] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Oct 19 00:45:37 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:38.111309 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-cdc9e687-9826-487d-9125-f09778bbb864 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:38.111937 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-cdc9e687-9826-487d-9125-f09778bbb864 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:38.119061 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cdc9e687-9826-487d-9125-f09778bbb864 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:38.119534 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cdc9e687-9826-487d-9125-f09778bbb864 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:38.119995 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cdc9e687-9826-487d-9125-f09778bbb864 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:38.120685 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cdc9e687-9826-487d-9125-f09778bbb864 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:38.121135 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cdc9e687-9826-487d-9125-f09778bbb864 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:38.121555 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cdc9e687-9826-487d-9125-f09778bbb864 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:38.255709 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-cdc9e687-9826-487d-9125-f09778bbb864 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:38.263773 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-cdc9e687-9826-487d-9125-f09778bbb864 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:38.265230 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-cdc9e687-9826-487d-9125-f09778bbb864 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:38.266322 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-cdc9e687-9826-487d-9125-f09778bbb864 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1407 microversion: 2.20 time: 0.158889 Oct 19 00:45:38.266881 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 404/794] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:38 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:38.858798 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-19d6d0ce-7401-43ca-9ee2-076e93b55e3d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:38.861074 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-19d6d0ce-7401-43ca-9ee2-076e93b55e3d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:38.867735 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-19d6d0ce-7401-43ca-9ee2-076e93b55e3d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:38.868250 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-19d6d0ce-7401-43ca-9ee2-076e93b55e3d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:38.868741 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-19d6d0ce-7401-43ca-9ee2-076e93b55e3d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:38.869383 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-19d6d0ce-7401-43ca-9ee2-076e93b55e3d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:38.869839 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-19d6d0ce-7401-43ca-9ee2-076e93b55e3d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:38.870264 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-19d6d0ce-7401-43ca-9ee2-076e93b55e3d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:38.899687 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-19d6d0ce-7401-43ca-9ee2-076e93b55e3d tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044802 Oct 19 00:45:38.900273 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 391/795] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Oct 19 00:45:38 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 19 00:45:38.981114 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-098a482d-3364-4086-a358-e34d449504aa tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:38.981609 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-098a482d-3364-4086-a358-e34d449504aa tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:38.983550 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:38.988952 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-098a482d-3364-4086-a358-e34d449504aa tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:38.989425 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-098a482d-3364-4086-a358-e34d449504aa tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:38.989858 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-098a482d-3364-4086-a358-e34d449504aa tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:38.990805 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-098a482d-3364-4086-a358-e34d449504aa tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:38.991257 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-098a482d-3364-4086-a358-e34d449504aa tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:38.991680 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-098a482d-3364-4086-a358-e34d449504aa tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:39.017726 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-098a482d-3364-4086-a358-e34d449504aa tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Going to try to terminate instance {{(pid=125532) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:45:39.091205 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-098a482d-3364-4086-a358-e34d449504aa tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 204 len: 0 microversion: 2.1 time: 0.113638 Oct 19 00:45:39.091786 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 405/796] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Oct 19 00:45:38 2022] DELETE /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:45:39.100333 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-a55067d9-3664-43b4-954e-c2ff04b9685f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:39.100947 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-a55067d9-3664-43b4-954e-c2ff04b9685f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:39.106957 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a55067d9-3664-43b4-954e-c2ff04b9685f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:39.107442 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a55067d9-3664-43b4-954e-c2ff04b9685f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:39.107900 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a55067d9-3664-43b4-954e-c2ff04b9685f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:39.108599 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a55067d9-3664-43b4-954e-c2ff04b9685f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:39.109057 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a55067d9-3664-43b4-954e-c2ff04b9685f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:39.109480 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a55067d9-3664-43b4-954e-c2ff04b9685f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:39.244813 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-a55067d9-3664-43b4-954e-c2ff04b9685f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:39.252561 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-a55067d9-3664-43b4-954e-c2ff04b9685f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1689 microversion: 2.1 time: 0.156389 Oct 19 00:45:39.253115 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 392/797] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:39 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:39.291131 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-2244aed3-8621-47ab-bfdc-86cb662fb1c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:39.291830 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-2244aed3-8621-47ab-bfdc-86cb662fb1c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:39.298096 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2244aed3-8621-47ab-bfdc-86cb662fb1c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:39.298576 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2244aed3-8621-47ab-bfdc-86cb662fb1c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:39.299011 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2244aed3-8621-47ab-bfdc-86cb662fb1c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:39.299703 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2244aed3-8621-47ab-bfdc-86cb662fb1c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:39.300178 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2244aed3-8621-47ab-bfdc-86cb662fb1c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:39.301232 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2244aed3-8621-47ab-bfdc-86cb662fb1c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:39.431687 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-2244aed3-8621-47ab-bfdc-86cb662fb1c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:39.439765 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-2244aed3-8621-47ab-bfdc-86cb662fb1c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:39.441800 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-2244aed3-8621-47ab-bfdc-86cb662fb1c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:39.443126 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-2244aed3-8621-47ab-bfdc-86cb662fb1c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1597 microversion: 2.20 time: 0.156330 Oct 19 00:45:39.443689 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 406/798] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:39 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1597 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:39.467172 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-416b03fc-16b5-4ed9-8068-57347b3bd71c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:39.467669 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-416b03fc-16b5-4ed9-8068-57347b3bd71c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:39.473968 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-416b03fc-16b5-4ed9-8068-57347b3bd71c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:39.474447 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-416b03fc-16b5-4ed9-8068-57347b3bd71c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:39.474913 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-416b03fc-16b5-4ed9-8068-57347b3bd71c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:39.475609 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-416b03fc-16b5-4ed9-8068-57347b3bd71c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:39.476122 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-416b03fc-16b5-4ed9-8068-57347b3bd71c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:39.476549 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-416b03fc-16b5-4ed9-8068-57347b3bd71c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:39.559888 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-416b03fc-16b5-4ed9-8068-57347b3bd71c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.096610 Oct 19 00:45:39.560486 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 393/799] 10.222.0.33 () {60 vars in 1316 bytes} [Wed Oct 19 00:45:39 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:45:40.275900 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-90b1d43a-23cc-4a20-ae19-73a7b8303993 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:40.276624 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-90b1d43a-23cc-4a20-ae19-73a7b8303993 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:40.282544 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-90b1d43a-23cc-4a20-ae19-73a7b8303993 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:40.283024 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-90b1d43a-23cc-4a20-ae19-73a7b8303993 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:40.283460 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-90b1d43a-23cc-4a20-ae19-73a7b8303993 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:40.284181 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-90b1d43a-23cc-4a20-ae19-73a7b8303993 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:40.284634 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-90b1d43a-23cc-4a20-ae19-73a7b8303993 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:40.285578 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-90b1d43a-23cc-4a20-ae19-73a7b8303993 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:40.422624 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-90b1d43a-23cc-4a20-ae19-73a7b8303993 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:40.431469 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-90b1d43a-23cc-4a20-ae19-73a7b8303993 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1689 microversion: 2.1 time: 0.159369 Oct 19 00:45:40.432069 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 407/800] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:40 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:40.479511 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-82df9da6-8bed-4032-b9b0-e8daefcc5ef5 req-07e69a83-5985-40ae-a80b-1dcce1e994c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a48c163-1acb-4ff4-8f2e-b6b529707da4", "tag": "3fc16ed1-ad15-4f2c-8cb0-7877e83842ab"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:40.489597 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-82df9da6-8bed-4032-b9b0-e8daefcc5ef5 req-07e69a83-5985-40ae-a80b-1dcce1e994c5 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:40.490143 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-82df9da6-8bed-4032-b9b0-e8daefcc5ef5 req-07e69a83-5985-40ae-a80b-1dcce1e994c5 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:40.490890 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-82df9da6-8bed-4032-b9b0-e8daefcc5ef5 req-07e69a83-5985-40ae-a80b-1dcce1e994c5 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:40.502111 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-82df9da6-8bed-4032-b9b0-e8daefcc5ef5 req-07e69a83-5985-40ae-a80b-1dcce1e994c5 service nova] Creating event network-changed:3fc16ed1-ad15-4f2c-8cb0-7877e83842ab for instance 7a48c163-1acb-4ff4-8f2e-b6b529707da4 on hv-cinder-maste Oct 19 00:45:40.507336 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-82df9da6-8bed-4032-b9b0-e8daefcc5ef5 req-07e69a83-5985-40ae-a80b-1dcce1e994c5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032038 Oct 19 00:45:40.507961 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 394/801] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:41.454557 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-05c0081a-3fbc-4336-a8c7-3d03e0ea5370 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:41.455272 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-05c0081a-3fbc-4336-a8c7-3d03e0ea5370 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:41.462878 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-05c0081a-3fbc-4336-a8c7-3d03e0ea5370 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:41.463394 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-05c0081a-3fbc-4336-a8c7-3d03e0ea5370 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:41.463826 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-05c0081a-3fbc-4336-a8c7-3d03e0ea5370 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:41.464532 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-05c0081a-3fbc-4336-a8c7-3d03e0ea5370 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:41.464978 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-05c0081a-3fbc-4336-a8c7-3d03e0ea5370 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:41.465393 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-05c0081a-3fbc-4336-a8c7-3d03e0ea5370 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:41.599107 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-05c0081a-3fbc-4336-a8c7-3d03e0ea5370 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:41.607326 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-05c0081a-3fbc-4336-a8c7-3d03e0ea5370 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1689 microversion: 2.1 time: 0.156582 Oct 19 00:45:41.607917 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 408/802] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:41 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:41.979781 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-dd3286cb-7dbf-4d71-9e0f-5441368a02b2 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-178460271", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-161843090", "security_groups": [{"name": "tempest-secgroup-smoke-359943502"}], "networks": [{"uuid": "9f9d19b4-f844-4fd6-89f7-139b72aa79dd"}], "block_device_mapping_v2": [{"uuid": "09519e5e-c543-4429-aa8f-294d54a3ba97", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:42.094536 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.network.neutron [None req-dd3286cb-7dbf-4d71-9e0f-5441368a02b2 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] validate_networks() for [('9f9d19b4-f844-4fd6-89f7-139b72aa79dd', None, None, None, None, None)] {{(pid=125531) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:45:42.549362 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-dd3286cb-7dbf-4d71-9e0f-5441368a02b2 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Flavor limits 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:45:42.549813 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-dd3286cb-7dbf-4d71-9e0f-5441368a02b2 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Image limits 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:45:42.550288 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-dd3286cb-7dbf-4d71-9e0f-5441368a02b2 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Flavor pref 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:45:42.550724 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-dd3286cb-7dbf-4d71-9e0f-5441368a02b2 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Image pref 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:45:42.551345 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-dd3286cb-7dbf-4d71-9e0f-5441368a02b2 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:45:42.560150 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dd3286cb-7dbf-4d71-9e0f-5441368a02b2 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:42.560628 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dd3286cb-7dbf-4d71-9e0f-5441368a02b2 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:42.561056 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dd3286cb-7dbf-4d71-9e0f-5441368a02b2 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:42.561782 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dd3286cb-7dbf-4d71-9e0f-5441368a02b2 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:42.562232 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dd3286cb-7dbf-4d71-9e0f-5441368a02b2 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:42.562655 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dd3286cb-7dbf-4d71-9e0f-5441368a02b2 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:42.579805 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.quota [None req-dd3286cb-7dbf-4d71-9e0f-5441368a02b2 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Getting quotas for project a98f43c385ec4522b38cc84d00bef279. Resources: {'instances', 'cores', 'ram'} {{(pid=125531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:45:42.584350 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.quota [None req-dd3286cb-7dbf-4d71-9e0f-5441368a02b2 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Getting quotas for user a3fe41c82b4844f8a4d38bd83206215a and project a98f43c385ec4522b38cc84d00bef279. Resources: {'instances', 'cores', 'ram'} {{(pid=125531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:45:42.631653 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-04ed468b-5e3e-4f51-a36a-8623de874e01 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:42.632432 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-04ed468b-5e3e-4f51-a36a-8623de874e01 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:42.638958 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-04ed468b-5e3e-4f51-a36a-8623de874e01 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:42.639596 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-04ed468b-5e3e-4f51-a36a-8623de874e01 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:42.639949 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-04ed468b-5e3e-4f51-a36a-8623de874e01 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:42.640656 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-04ed468b-5e3e-4f51-a36a-8623de874e01 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:42.641159 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-04ed468b-5e3e-4f51-a36a-8623de874e01 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:42.641589 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-04ed468b-5e3e-4f51-a36a-8623de874e01 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:42.642416 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-dd3286cb-7dbf-4d71-9e0f-5441368a02b2 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Going to run 1 instances... {{(pid=125531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:45:42.645278 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-dd3286cb-7dbf-4d71-9e0f-5441368a02b2 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='09519e5e-c543-4429-aa8f-294d54a3ba97',volume_size=None,volume_type=None)] {{(pid=125531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:45:42.776859 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-04ed468b-5e3e-4f51-a36a-8623de874e01 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:42.778188 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-dd3286cb-7dbf-4d71-9e0f-5441368a02b2 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.803068 Oct 19 00:45:42.779056 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 395/803] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Oct 19 00:45:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 00:45:42.786132 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-04ed468b-5e3e-4f51-a36a-8623de874e01 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1689 microversion: 2.1 time: 0.159193 Oct 19 00:45:42.786709 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 409/804] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:42 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:45:42.790283 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-6f6fb7f4-fb44-4dd2-8611-d56e63f425d8 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:42.790904 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-6f6fb7f4-fb44-4dd2-8611-d56e63f425d8 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:42.851421 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-6f6fb7f4-fb44-4dd2-8611-d56e63f425d8 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:42.858575 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-6f6fb7f4-fb44-4dd2-8611-d56e63f425d8 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1087 microversion: 2.1 time: 0.072241 Oct 19 00:45:42.859149 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 396/805] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:42 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1087 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:45:43.810488 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-158b8dca-d4fe-4839-b881-f82a6f91cfc0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:43.811104 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-158b8dca-d4fe-4839-b881-f82a6f91cfc0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:43.818449 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-158b8dca-d4fe-4839-b881-f82a6f91cfc0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:43.819095 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-158b8dca-d4fe-4839-b881-f82a6f91cfc0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:43.819600 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-158b8dca-d4fe-4839-b881-f82a6f91cfc0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:43.820409 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-158b8dca-d4fe-4839-b881-f82a6f91cfc0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:43.821018 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-158b8dca-d4fe-4839-b881-f82a6f91cfc0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:43.821637 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-158b8dca-d4fe-4839-b881-f82a6f91cfc0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:43.883470 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-8559bed9-0be1-4041-b1a4-d231220df0e3 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:43.885257 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-8559bed9-0be1-4041-b1a4-d231220df0e3 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:43.892175 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8559bed9-0be1-4041-b1a4-d231220df0e3 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:43.892730 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8559bed9-0be1-4041-b1a4-d231220df0e3 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:43.893263 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8559bed9-0be1-4041-b1a4-d231220df0e3 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:43.894018 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8559bed9-0be1-4041-b1a4-d231220df0e3 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:43.895167 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8559bed9-0be1-4041-b1a4-d231220df0e3 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:43.895679 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8559bed9-0be1-4041-b1a4-d231220df0e3 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:43.969137 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-8559bed9-0be1-4041-b1a4-d231220df0e3 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:43.979041 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-8559bed9-0be1-4041-b1a4-d231220df0e3 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1185 microversion: 2.1 time: 0.100694 Oct 19 00:45:43.979943 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 397/806] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:43 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:44.136513 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-158b8dca-d4fe-4839-b881-f82a6f91cfc0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:44.144993 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-158b8dca-d4fe-4839-b881-f82a6f91cfc0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1689 microversion: 2.1 time: 0.338360 Oct 19 00:45:44.145789 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 410/807] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:43 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1689 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:44.924941 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-cfe05bc4-8ad5-4d5a-852a-340a2962b7a8 req-443244a3-f4f4-4907-9fcd-8fa612012645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b862704-38e5-4ea8-9fa2-741591535b6f", "name": "network-vif-deleted", "tag": "1d63aec2-4f59-4c65-8d08-0a5e740a5e12"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:44.939194 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-cfe05bc4-8ad5-4d5a-852a-340a2962b7a8 req-443244a3-f4f4-4907-9fcd-8fa612012645 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:44.939888 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-cfe05bc4-8ad5-4d5a-852a-340a2962b7a8 req-443244a3-f4f4-4907-9fcd-8fa612012645 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:44.940414 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-cfe05bc4-8ad5-4d5a-852a-340a2962b7a8 req-443244a3-f4f4-4907-9fcd-8fa612012645 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:44.953769 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-cfe05bc4-8ad5-4d5a-852a-340a2962b7a8 req-443244a3-f4f4-4907-9fcd-8fa612012645 service nova] Creating event network-vif-deleted:1d63aec2-4f59-4c65-8d08-0a5e740a5e12 for instance 4b862704-38e5-4ea8-9fa2-741591535b6f on hv-cinder-maste Oct 19 00:45:44.961223 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-cfe05bc4-8ad5-4d5a-852a-340a2962b7a8 req-443244a3-f4f4-4907-9fcd-8fa612012645 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045862 Oct 19 00:45:44.962597 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 398/808] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:45.004383 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-35186963-ec11-485d-a660-5cabecb203f9 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:45.005844 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-35186963-ec11-485d-a660-5cabecb203f9 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:45.018243 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-35186963-ec11-485d-a660-5cabecb203f9 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:45.022287 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-35186963-ec11-485d-a660-5cabecb203f9 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:45.023182 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-35186963-ec11-485d-a660-5cabecb203f9 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:45.024090 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-35186963-ec11-485d-a660-5cabecb203f9 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:45.024645 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-35186963-ec11-485d-a660-5cabecb203f9 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:45.025316 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-35186963-ec11-485d-a660-5cabecb203f9 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:45.104575 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-35186963-ec11-485d-a660-5cabecb203f9 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:45.113990 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-35186963-ec11-485d-a660-5cabecb203f9 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1203 microversion: 2.1 time: 0.113878 Oct 19 00:45:45.132729 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 411/809] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:44 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1203 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:45.173942 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-1d95c6bc-dadd-4571-9f08-3b20cf5baf0e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:45.175245 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-1d95c6bc-dadd-4571-9f08-3b20cf5baf0e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:45.195231 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1d95c6bc-dadd-4571-9f08-3b20cf5baf0e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:45.195754 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1d95c6bc-dadd-4571-9f08-3b20cf5baf0e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:45.196750 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1d95c6bc-dadd-4571-9f08-3b20cf5baf0e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:45.200568 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1d95c6bc-dadd-4571-9f08-3b20cf5baf0e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:45.201090 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1d95c6bc-dadd-4571-9f08-3b20cf5baf0e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:45.202952 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1d95c6bc-dadd-4571-9f08-3b20cf5baf0e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:45.257207 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1d95c6bc-dadd-4571-9f08-3b20cf5baf0e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:45.257868 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1d95c6bc-dadd-4571-9f08-3b20cf5baf0e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:45.258428 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1d95c6bc-dadd-4571-9f08-3b20cf5baf0e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:45.258956 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.objects.instance [None req-1d95c6bc-dadd-4571-9f08-3b20cf5baf0e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lazy-loading 'fault' on Instance uuid 4b862704-38e5-4ea8-9fa2-741591535b6f {{(pid=125531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:45:45.313751 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-1d95c6bc-dadd-4571-9f08-3b20cf5baf0e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:45.326878 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-1d95c6bc-dadd-4571-9f08-3b20cf5baf0e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 200 len: 1334 microversion: 2.1 time: 0.157932 Oct 19 00:45:45.339983 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 399/810] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:45 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 1334 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:46.141867 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-f2e32b8e-ce72-47ca-be8c-d089b51e26ff tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:46.142512 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-f2e32b8e-ce72-47ca-be8c-d089b51e26ff tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:46.150257 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f2e32b8e-ce72-47ca-be8c-d089b51e26ff tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:46.151018 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f2e32b8e-ce72-47ca-be8c-d089b51e26ff tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:46.151747 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f2e32b8e-ce72-47ca-be8c-d089b51e26ff tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:46.152678 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f2e32b8e-ce72-47ca-be8c-d089b51e26ff tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:46.153434 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f2e32b8e-ce72-47ca-be8c-d089b51e26ff tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:46.154065 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f2e32b8e-ce72-47ca-be8c-d089b51e26ff tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:46.290300 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-f2e32b8e-ce72-47ca-be8c-d089b51e26ff tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:46.292793 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:46.300807 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-f2e32b8e-ce72-47ca-be8c-d089b51e26ff tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1258 microversion: 2.1 time: 0.162593 Oct 19 00:45:46.301605 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 412/811] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:46 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:46.351830 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-eb602db7-f8aa-4200-976b-58d52994c214 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:46.352628 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-eb602db7-f8aa-4200-976b-58d52994c214 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4b862704-38e5-4ea8-9fa2-741591535b6f] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:46.358894 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-eb602db7-f8aa-4200-976b-58d52994c214 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:46.359382 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-eb602db7-f8aa-4200-976b-58d52994c214 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:46.359827 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-eb602db7-f8aa-4200-976b-58d52994c214 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:46.360557 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-eb602db7-f8aa-4200-976b-58d52994c214 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:46.361012 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-eb602db7-f8aa-4200-976b-58d52994c214 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:46.361441 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-eb602db7-f8aa-4200-976b-58d52994c214 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:46.377579 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.wsgi [None req-eb602db7-f8aa-4200-976b-58d52994c214 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] HTTP exception thrown: Instance 4b862704-38e5-4ea8-9fa2-741591535b6f could not be found. Oct 19 00:45:46.379442 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-eb602db7-f8aa-4200-976b-58d52994c214 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Request method failure captured: Oct 19 00:45:46.379442 dv-cinder-master-3-smb devstack@n-api.service[125531]: request: GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f HTTP/1.1 Oct 19 00:45:46.379442 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept: application/json Oct 19 00:45:46.379442 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept-Encoding: identity Oct 19 00:45:46.379442 dv-cinder-master-3-smb devstack@n-api.service[125531]: Connection: close Oct 19 00:45:46.379442 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Length: 0 Oct 19 00:45:46.379442 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Type: application/json Oct 19 00:45:46.379442 dv-cinder-master-3-smb devstack@n-api.service[125531]: Host: 10.222.0.33 Oct 19 00:45:46.379442 dv-cinder-master-3-smb devstack@n-api.service[125531]: Openstack-System-Scope: None Oct 19 00:45:46.379442 dv-cinder-master-3-smb devstack@n-api.service[125531]: User-Agent: python-urllib3/1.26.12 Oct 19 00:45:46.379442 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Auth-Token: gAAAAABjT0dZ_4FF8isbZtl7c5-GdMjgtdkzBRByQoOzSTUxRPm0NU1bMkTSg3nCD_LApNQSolFnUFcfFlewlCxUoOsWoj9qCOzOsCRlZMSRn6X12ufFgLR_KoHBG97yFQ-9UyMgZvW2127GxTVAcAuSg_loWUS1yl5fwx-10demwDus7CXkRQ8 Oct 19 00:45:46.379442 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Id: None Oct 19 00:45:46.379442 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Name: None Oct 19 00:45:46.379442 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Identity-Status: Confirmed Oct 19 00:45:46.379442 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Is-Admin-Project: True Oct 19 00:45:46.379442 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Id: default Oct 19 00:45:46.379442 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Name: Default Oct 19 00:45:46.379442 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Id: 5a230211180742ef9efd4d62b630d211 Oct 19 00:45:46.379442 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-748606272 Oct 19 00:45:46.379442 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Role: member,reader Oct 19 00:45:46.379442 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Roles: member,reader Oct 19 00:45:46.381271 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a230211180742ef9efd4d62b630d211"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a230211180742ef9efd4d62b630d211"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a230211180742ef9efd4d62b630d211"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a230211180742ef9efd4d62b630d211"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:45:46.381271 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant: tempest-ServerRescueNegativeTestJSON-748606272 Oct 19 00:45:46.381271 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Id: 5a230211180742ef9efd4d62b630d211 Oct 19 00:45:46.381271 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-748606272 Oct 19 00:45:46.381271 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User: tempest-ServerRescueNegativeTestJSON-748606272-project Oct 19 00:45:46.381271 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Id: default Oct 19 00:45:46.381271 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Name: Default Oct 19 00:45:46.381271 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Id: 5628a861c90042d88b95f2d7b898ed52 Oct 19 00:45:46.381271 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Name: tempest-ServerRescueNegativeTestJSON-748606272-project Oct 19 00:45:46.381271 dv-cinder-master-3-smb devstack@n-api.service[125531]: method: > Oct 19 00:45:46.381271 dv-cinder-master-3-smb devstack@n-api.service[125531]: exception: Instance 4b862704-38e5-4ea8-9fa2-741591535b6f could not be found. Oct 19 00:45:46.381271 dv-cinder-master-3-smb devstack@n-api.service[125531]: action_args: {'id': '4b862704-38e5-4ea8-9fa2-741591535b6f'} Oct 19 00:45:46.382108 dv-cinder-master-3-smb devstack@n-api.service[125531]: {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:45:46.382108 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:46.382108 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:45:46.382108 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:45:46.382108 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:45:46.382108 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:45:46.382108 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:45:46.382108 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:45:46.382108 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:45:46.382108 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:45:46.382108 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b862704-38e5-4ea8-9fa2-741591535b6f could not be found. Oct 19 00:45:46.382108 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:45:46.382108 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:45:46.382108 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:45:46.382108 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:46.382108 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:45:46.382108 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:45:46.382108 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:45:46.382108 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:45:46.382108 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:45:46.383669 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:45:46.383669 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:45:46.383669 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:45:46.383669 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:45:46.383669 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:45:46.383669 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:45:46.383669 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:45:46.383669 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b862704-38e5-4ea8-9fa2-741591535b6f could not be found. Oct 19 00:45:46.383669 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:45:46.383669 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:45:46.383669 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:45:46.383669 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:46.383669 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:45:46.383669 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:45:46.383669 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:45:46.383669 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:45:46.383669 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b862704-38e5-4ea8-9fa2-741591535b6f could not be found. Oct 19 00:45:46.383669 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:45:46.385123 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-eb602db7-f8aa-4200-976b-58d52994c214 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Returning 404 to user: Instance 4b862704-38e5-4ea8-9fa2-741591535b6f could not be found. {{(pid=125531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:45:46.385123 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-eb602db7-f8aa-4200-976b-58d52994c214 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f" status: 404 len: 111 microversion: 2.1 time: 0.033903 Oct 19 00:45:46.385123 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 400/812] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:46 2022] GET /compute/v2.1/servers/4b862704-38e5-4ea8-9fa2-741591535b6f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 00:45:46.389741 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-6471c7a4-5d7a-4a0c-9ade-eabc3e7cf19c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '.version_select at 0x7f81f0fb54c0>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:46.409343 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-6471c7a4-5d7a-4a0c-9ade-eabc3e7cf19c tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1784206753" status: 202 len: 0 microversion: 2.1 time: 0.023309 Oct 19 00:45:46.410532 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 413/813] 10.222.0.33 () {58 vars in 1221 bytes} [Wed Oct 19 00:45:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1784206753 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:45:46.517854 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-ae5b0a07-c67f-422b-970d-9c960e29c38b req-a874c1a6-1e17-4dd7-9217-ba63f6c12c08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a4f60d9-b884-40cb-a416-b34e456f77e9", "tag": "8d31d467-6029-44f7-b3e8-25183019299e"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:46.544296 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-ae5b0a07-c67f-422b-970d-9c960e29c38b req-a874c1a6-1e17-4dd7-9217-ba63f6c12c08 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:46.545139 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-ae5b0a07-c67f-422b-970d-9c960e29c38b req-a874c1a6-1e17-4dd7-9217-ba63f6c12c08 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:46.545666 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-ae5b0a07-c67f-422b-970d-9c960e29c38b req-a874c1a6-1e17-4dd7-9217-ba63f6c12c08 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:46.558546 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-ae5b0a07-c67f-422b-970d-9c960e29c38b req-a874c1a6-1e17-4dd7-9217-ba63f6c12c08 service nova] Creating event network-changed:8d31d467-6029-44f7-b3e8-25183019299e for instance 6a4f60d9-b884-40cb-a416-b34e456f77e9 on hv-cinder-maste Oct 19 00:45:46.563829 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-ae5b0a07-c67f-422b-970d-9c960e29c38b req-a874c1a6-1e17-4dd7-9217-ba63f6c12c08 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049661 Oct 19 00:45:46.565114 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 401/814] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:47.325490 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-7cbae967-49fa-4d98-9041-bc635331b5ff tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:47.326223 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-7cbae967-49fa-4d98-9041-bc635331b5ff tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:47.333193 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7cbae967-49fa-4d98-9041-bc635331b5ff tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:47.333787 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7cbae967-49fa-4d98-9041-bc635331b5ff tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:47.334335 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7cbae967-49fa-4d98-9041-bc635331b5ff tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:47.335092 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7cbae967-49fa-4d98-9041-bc635331b5ff tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:47.335646 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7cbae967-49fa-4d98-9041-bc635331b5ff tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:47.336245 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7cbae967-49fa-4d98-9041-bc635331b5ff tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:47.475371 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-7cbae967-49fa-4d98-9041-bc635331b5ff tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:47.483280 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-7cbae967-49fa-4d98-9041-bc635331b5ff tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1258 microversion: 2.1 time: 0.162141 Oct 19 00:45:47.483872 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 414/815] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:47 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:48.510103 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-7c7731bb-eb7e-4184-a753-1ffff4596181 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:48.510842 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-7c7731bb-eb7e-4184-a753-1ffff4596181 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:48.517401 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7c7731bb-eb7e-4184-a753-1ffff4596181 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:48.517885 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7c7731bb-eb7e-4184-a753-1ffff4596181 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:48.518323 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7c7731bb-eb7e-4184-a753-1ffff4596181 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:48.519017 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7c7731bb-eb7e-4184-a753-1ffff4596181 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:48.519536 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7c7731bb-eb7e-4184-a753-1ffff4596181 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:48.519991 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7c7731bb-eb7e-4184-a753-1ffff4596181 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:48.655501 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-7c7731bb-eb7e-4184-a753-1ffff4596181 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:48.663977 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-7c7731bb-eb7e-4184-a753-1ffff4596181 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1258 microversion: 2.1 time: 0.158079 Oct 19 00:45:48.664537 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 402/816] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:48 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:49.537432 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-bcea71fc-0f7d-4bae-90ea-6bb1e753bbf7 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:49.537917 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-bcea71fc-0f7d-4bae-90ea-6bb1e753bbf7 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:49.544278 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-bcea71fc-0f7d-4bae-90ea-6bb1e753bbf7 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:49.544752 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-bcea71fc-0f7d-4bae-90ea-6bb1e753bbf7 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:49.545182 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-bcea71fc-0f7d-4bae-90ea-6bb1e753bbf7 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:49.545863 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-bcea71fc-0f7d-4bae-90ea-6bb1e753bbf7 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:49.546312 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-bcea71fc-0f7d-4bae-90ea-6bb1e753bbf7 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:49.546729 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-bcea71fc-0f7d-4bae-90ea-6bb1e753bbf7 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:49.571894 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-bcea71fc-0f7d-4bae-90ea-6bb1e753bbf7 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Going to try to terminate instance {{(pid=125532) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:45:49.647865 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-bcea71fc-0f7d-4bae-90ea-6bb1e753bbf7 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "DELETE /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 204 len: 0 microversion: 2.1 time: 0.114119 Oct 19 00:45:49.648463 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 415/817] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Oct 19 00:45:49 2022] DELETE /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:45:49.656669 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-e4dd3e34-6632-4aa7-95ea-5d3e4b009333 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:49.657303 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-e4dd3e34-6632-4aa7-95ea-5d3e4b009333 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:49.663981 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e4dd3e34-6632-4aa7-95ea-5d3e4b009333 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:49.664463 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e4dd3e34-6632-4aa7-95ea-5d3e4b009333 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:49.664897 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e4dd3e34-6632-4aa7-95ea-5d3e4b009333 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:49.665592 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e4dd3e34-6632-4aa7-95ea-5d3e4b009333 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:49.666044 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e4dd3e34-6632-4aa7-95ea-5d3e4b009333 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:49.666490 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e4dd3e34-6632-4aa7-95ea-5d3e4b009333 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:49.687816 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-de1bc83f-60f8-448e-b34a-797ec6599976 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:49.688691 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-de1bc83f-60f8-448e-b34a-797ec6599976 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:49.695685 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-de1bc83f-60f8-448e-b34a-797ec6599976 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:49.696211 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-de1bc83f-60f8-448e-b34a-797ec6599976 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:49.696652 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-de1bc83f-60f8-448e-b34a-797ec6599976 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:49.697352 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-de1bc83f-60f8-448e-b34a-797ec6599976 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:49.697882 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-de1bc83f-60f8-448e-b34a-797ec6599976 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:49.698446 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-de1bc83f-60f8-448e-b34a-797ec6599976 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:49.830000 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-e4dd3e34-6632-4aa7-95ea-5d3e4b009333 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:49.837244 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-de1bc83f-60f8-448e-b34a-797ec6599976 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:49.837922 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-e4dd3e34-6632-4aa7-95ea-5d3e4b009333 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1507 microversion: 2.1 time: 0.185311 Oct 19 00:45:49.838510 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 403/818] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:49 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1507 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:49.844968 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-de1bc83f-60f8-448e-b34a-797ec6599976 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1258 microversion: 2.1 time: 0.161374 Oct 19 00:45:49.845722 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 416/819] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:49 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:45:50.860743 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-cec747d7-e383-43f3-9579-448478e1883a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:50.861359 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-cec747d7-e383-43f3-9579-448478e1883a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:50.868518 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-b5dcad73-43f0-4e74-aa33-526e9efb442b tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:50.869004 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cec747d7-e383-43f3-9579-448478e1883a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:50.869112 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-b5dcad73-43f0-4e74-aa33-526e9efb442b tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:50.869414 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cec747d7-e383-43f3-9579-448478e1883a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:50.869851 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cec747d7-e383-43f3-9579-448478e1883a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:50.870551 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cec747d7-e383-43f3-9579-448478e1883a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:50.871002 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cec747d7-e383-43f3-9579-448478e1883a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:50.871422 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cec747d7-e383-43f3-9579-448478e1883a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:50.876115 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b5dcad73-43f0-4e74-aa33-526e9efb442b tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:50.876599 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b5dcad73-43f0-4e74-aa33-526e9efb442b tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:50.877220 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b5dcad73-43f0-4e74-aa33-526e9efb442b tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:50.877978 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b5dcad73-43f0-4e74-aa33-526e9efb442b tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:50.878418 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b5dcad73-43f0-4e74-aa33-526e9efb442b tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:50.879716 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b5dcad73-43f0-4e74-aa33-526e9efb442b tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:51.014193 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-b5dcad73-43f0-4e74-aa33-526e9efb442b tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:51.023629 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-b5dcad73-43f0-4e74-aa33-526e9efb442b tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1258 microversion: 2.1 time: 0.159341 Oct 19 00:45:51.024238 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 417/820] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:50 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:45:51.088102 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-cec747d7-e383-43f3-9579-448478e1883a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:51.099990 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-cec747d7-e383-43f3-9579-448478e1883a tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1507 microversion: 2.1 time: 0.242981 Oct 19 00:45:51.100562 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 404/821] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:50 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1507 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:52.046636 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-13631d80-ad43-4901-9227-ed43a4fcece7 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:52.047342 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-13631d80-ad43-4901-9227-ed43a4fcece7 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:52.054530 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-13631d80-ad43-4901-9227-ed43a4fcece7 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:52.055080 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-13631d80-ad43-4901-9227-ed43a4fcece7 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:52.055602 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-13631d80-ad43-4901-9227-ed43a4fcece7 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:52.056387 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-13631d80-ad43-4901-9227-ed43a4fcece7 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:52.056839 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-13631d80-ad43-4901-9227-ed43a4fcece7 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:52.057261 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-13631d80-ad43-4901-9227-ed43a4fcece7 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:52.123233 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-f4fa6855-61b1-4672-91bb-9d0b9fcb3f58 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:52.124495 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-f4fa6855-61b1-4672-91bb-9d0b9fcb3f58 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:52.132221 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f4fa6855-61b1-4672-91bb-9d0b9fcb3f58 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:52.132920 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f4fa6855-61b1-4672-91bb-9d0b9fcb3f58 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:52.133519 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f4fa6855-61b1-4672-91bb-9d0b9fcb3f58 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:52.134400 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f4fa6855-61b1-4672-91bb-9d0b9fcb3f58 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:52.135004 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f4fa6855-61b1-4672-91bb-9d0b9fcb3f58 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:52.135597 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f4fa6855-61b1-4672-91bb-9d0b9fcb3f58 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:52.218046 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-13631d80-ad43-4901-9227-ed43a4fcece7 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:52.224004 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-f4fa6855-61b1-4672-91bb-9d0b9fcb3f58 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:52.226058 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-13631d80-ad43-4901-9227-ed43a4fcece7 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1258 microversion: 2.1 time: 0.183342 Oct 19 00:45:52.227016 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 418/822] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:52 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1258 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:52.234233 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-f4fa6855-61b1-4672-91bb-9d0b9fcb3f58 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 200 len: 1465 microversion: 2.1 time: 0.114765 Oct 19 00:45:52.234888 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 405/823] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:52 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 1465 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:52.251098 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-26a6ab64-0bf4-45dd-8069-fdd134796956 req-8d2b57f2-ec90-42ce-b7d7-8233cd0dfbc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "961ac14f-b764-4468-baa3-a3aa1eb26627", "name": "network-vif-deleted", "tag": "0d78e5c5-2afd-4926-8fbf-05fc0868ef06"}]} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:52.262267 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-26a6ab64-0bf4-45dd-8069-fdd134796956 req-8d2b57f2-ec90-42ce-b7d7-8233cd0dfbc0 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:52.262741 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-26a6ab64-0bf4-45dd-8069-fdd134796956 req-8d2b57f2-ec90-42ce-b7d7-8233cd0dfbc0 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:52.263164 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-26a6ab64-0bf4-45dd-8069-fdd134796956 req-8d2b57f2-ec90-42ce-b7d7-8233cd0dfbc0 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:52.274555 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.compute.server_external_events [req-26a6ab64-0bf4-45dd-8069-fdd134796956 req-8d2b57f2-ec90-42ce-b7d7-8233cd0dfbc0 service nova] Creating event network-vif-deleted:0d78e5c5-2afd-4926-8fbf-05fc0868ef06 for instance 961ac14f-b764-4468-baa3-a3aa1eb26627 on hv-cinder-maste Oct 19 00:45:52.279460 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-26a6ab64-0bf4-45dd-8069-fdd134796956 req-8d2b57f2-ec90-42ce-b7d7-8233cd0dfbc0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032125 Oct 19 00:45:52.280116 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 419/824] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:53.250160 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-ec3ab425-0d5e-4e8e-a676-c446c40cae43 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:53.250842 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-ec3ab425-0d5e-4e8e-a676-c446c40cae43 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:53.252947 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell0:SELECT=2 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:53.254087 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell0:SELECT=8 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:53.260339 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-1797958c-c5c7-4cf5-a9ef-8f07feb91ddb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:53.261165 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-1797958c-c5c7-4cf5-a9ef-8f07feb91ddb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 961ac14f-b764-4468-baa3-a3aa1eb26627] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:53.263056 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ec3ab425-0d5e-4e8e-a676-c446c40cae43 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:53.263583 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ec3ab425-0d5e-4e8e-a676-c446c40cae43 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:53.264098 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ec3ab425-0d5e-4e8e-a676-c446c40cae43 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:53.265434 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ec3ab425-0d5e-4e8e-a676-c446c40cae43 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:53.265931 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ec3ab425-0d5e-4e8e-a676-c446c40cae43 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:53.266388 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ec3ab425-0d5e-4e8e-a676-c446c40cae43 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:53.268613 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1797958c-c5c7-4cf5-a9ef-8f07feb91ddb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:53.269352 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1797958c-c5c7-4cf5-a9ef-8f07feb91ddb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:53.270440 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1797958c-c5c7-4cf5-a9ef-8f07feb91ddb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:53.271302 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1797958c-c5c7-4cf5-a9ef-8f07feb91ddb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:53.272447 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1797958c-c5c7-4cf5-a9ef-8f07feb91ddb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:53.272952 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1797958c-c5c7-4cf5-a9ef-8f07feb91ddb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:53.288035 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.wsgi [None req-1797958c-c5c7-4cf5-a9ef-8f07feb91ddb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] HTTP exception thrown: Instance 961ac14f-b764-4468-baa3-a3aa1eb26627 could not be found. Oct 19 00:45:53.289975 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-1797958c-c5c7-4cf5-a9ef-8f07feb91ddb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Request method failure captured: Oct 19 00:45:53.289975 dv-cinder-master-3-smb devstack@n-api.service[125532]: request: GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 HTTP/1.1 Oct 19 00:45:53.289975 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept: application/json Oct 19 00:45:53.289975 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept-Encoding: identity Oct 19 00:45:53.289975 dv-cinder-master-3-smb devstack@n-api.service[125532]: Connection: close Oct 19 00:45:53.289975 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Length: 0 Oct 19 00:45:53.289975 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Type: application/json Oct 19 00:45:53.289975 dv-cinder-master-3-smb devstack@n-api.service[125532]: Host: 10.222.0.33 Oct 19 00:45:53.289975 dv-cinder-master-3-smb devstack@n-api.service[125532]: Openstack-System-Scope: None Oct 19 00:45:53.289975 dv-cinder-master-3-smb devstack@n-api.service[125532]: User-Agent: python-urllib3/1.26.12 Oct 19 00:45:53.289975 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Auth-Token: gAAAAABjT0dZ_4FF8isbZtl7c5-GdMjgtdkzBRByQoOzSTUxRPm0NU1bMkTSg3nCD_LApNQSolFnUFcfFlewlCxUoOsWoj9qCOzOsCRlZMSRn6X12ufFgLR_KoHBG97yFQ-9UyMgZvW2127GxTVAcAuSg_loWUS1yl5fwx-10demwDus7CXkRQ8 Oct 19 00:45:53.289975 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Id: None Oct 19 00:45:53.289975 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Name: None Oct 19 00:45:53.289975 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Identity-Status: Confirmed Oct 19 00:45:53.289975 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Is-Admin-Project: True Oct 19 00:45:53.289975 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Id: default Oct 19 00:45:53.289975 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Name: Default Oct 19 00:45:53.289975 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Id: 5a230211180742ef9efd4d62b630d211 Oct 19 00:45:53.289975 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-748606272 Oct 19 00:45:53.289975 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Role: member,reader Oct 19 00:45:53.289975 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Roles: member,reader Oct 19 00:45:53.291372 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a230211180742ef9efd4d62b630d211"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a230211180742ef9efd4d62b630d211"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a230211180742ef9efd4d62b630d211"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a230211180742ef9efd4d62b630d211"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:45:53.291372 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant: tempest-ServerRescueNegativeTestJSON-748606272 Oct 19 00:45:53.291372 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Id: 5a230211180742ef9efd4d62b630d211 Oct 19 00:45:53.291372 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-748606272 Oct 19 00:45:53.291372 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User: tempest-ServerRescueNegativeTestJSON-748606272-project Oct 19 00:45:53.291372 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Id: default Oct 19 00:45:53.291372 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Name: Default Oct 19 00:45:53.291372 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Id: 5628a861c90042d88b95f2d7b898ed52 Oct 19 00:45:53.291372 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Name: tempest-ServerRescueNegativeTestJSON-748606272-project Oct 19 00:45:53.291372 dv-cinder-master-3-smb devstack@n-api.service[125532]: method: > Oct 19 00:45:53.291372 dv-cinder-master-3-smb devstack@n-api.service[125532]: exception: Instance 961ac14f-b764-4468-baa3-a3aa1eb26627 could not be found. Oct 19 00:45:53.291372 dv-cinder-master-3-smb devstack@n-api.service[125532]: action_args: {'id': '961ac14f-b764-4468-baa3-a3aa1eb26627'} Oct 19 00:45:53.292174 dv-cinder-master-3-smb devstack@n-api.service[125532]: {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:45:53.292174 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:53.292174 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:45:53.292174 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:45:53.292174 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:45:53.292174 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:45:53.292174 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:45:53.292174 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:45:53.292174 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:45:53.292174 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:45:53.292174 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 961ac14f-b764-4468-baa3-a3aa1eb26627 could not be found. Oct 19 00:45:53.292174 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:45:53.292174 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:45:53.292174 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:45:53.292174 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:53.292174 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:45:53.292174 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:45:53.292174 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:45:53.292174 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:45:53.292174 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:45:53.293384 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:45:53.293384 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:45:53.293384 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:45:53.293384 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:45:53.293384 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:45:53.293384 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:45:53.293384 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:45:53.293384 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 961ac14f-b764-4468-baa3-a3aa1eb26627 could not be found. Oct 19 00:45:53.293384 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:45:53.293384 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:45:53.293384 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:45:53.293384 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:53.293384 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:45:53.293384 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:45:53.293384 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:45:53.293384 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:45:53.293384 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 961ac14f-b764-4468-baa3-a3aa1eb26627 could not be found. Oct 19 00:45:53.293384 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:45:53.295806 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-1797958c-c5c7-4cf5-a9ef-8f07feb91ddb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Returning 404 to user: Instance 961ac14f-b764-4468-baa3-a3aa1eb26627 could not be found. {{(pid=125532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:45:53.296713 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-1797958c-c5c7-4cf5-a9ef-8f07feb91ddb tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627" status: 404 len: 111 microversion: 2.1 time: 0.041675 Oct 19 00:45:53.297582 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 420/825] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:53 2022] GET /compute/v2.1/servers/961ac14f-b764-4468-baa3-a3aa1eb26627 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:45:53.306027 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-236ab47a-f3b7-4805-8bdb-b8354fc33329 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:53.306619 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-236ab47a-f3b7-4805-8bdb-b8354fc33329 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4389c416-28bf-4b8e-945e-386f38c16859] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:53.313186 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-236ab47a-f3b7-4805-8bdb-b8354fc33329 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:53.313682 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-236ab47a-f3b7-4805-8bdb-b8354fc33329 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:53.314127 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-236ab47a-f3b7-4805-8bdb-b8354fc33329 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:53.314842 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-236ab47a-f3b7-4805-8bdb-b8354fc33329 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:53.315300 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-236ab47a-f3b7-4805-8bdb-b8354fc33329 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:53.315729 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-236ab47a-f3b7-4805-8bdb-b8354fc33329 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:53.344595 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-236ab47a-f3b7-4805-8bdb-b8354fc33329 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4389c416-28bf-4b8e-945e-386f38c16859] Going to try to terminate instance {{(pid=125532) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:45:53.423110 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-ec3ab425-0d5e-4e8e-a676-c446c40cae43 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:53.429349 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-236ab47a-f3b7-4805-8bdb-b8354fc33329 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859" status: 204 len: 0 microversion: 2.1 time: 0.126972 Oct 19 00:45:53.430117 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 421/826] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Oct 19 00:45:53 2022] DELETE /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 00:45:53.435666 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-a31239c0-b01e-4ede-8435-a3243ceb61b1 req-b4ce1c12-2c04-4482-a461-6b86363df78f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a4f60d9-b884-40cb-a416-b34e456f77e9", "name": "network-vif-plugged", "status": "completed", "tag": "8d31d467-6029-44f7-b3e8-25183019299e"}]} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:53.436843 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-ec3ab425-0d5e-4e8e-a676-c446c40cae43 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1258 microversion: 2.1 time: 0.190733 Oct 19 00:45:53.437410 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 406/827] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:53 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1258 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:53.443056 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-38fecdd8-649d-4c16-b4b7-755228dd33e8 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:53.443659 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-38fecdd8-649d-4c16-b4b7-755228dd33e8 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4389c416-28bf-4b8e-945e-386f38c16859] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:53.445883 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-a31239c0-b01e-4ede-8435-a3243ceb61b1 req-b4ce1c12-2c04-4482-a461-6b86363df78f service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:53.446390 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-a31239c0-b01e-4ede-8435-a3243ceb61b1 req-b4ce1c12-2c04-4482-a461-6b86363df78f service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:53.446831 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-a31239c0-b01e-4ede-8435-a3243ceb61b1 req-b4ce1c12-2c04-4482-a461-6b86363df78f service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:53.452293 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-38fecdd8-649d-4c16-b4b7-755228dd33e8 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:53.452860 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-38fecdd8-649d-4c16-b4b7-755228dd33e8 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:53.453530 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-38fecdd8-649d-4c16-b4b7-755228dd33e8 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:53.454287 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-38fecdd8-649d-4c16-b4b7-755228dd33e8 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:53.454745 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-38fecdd8-649d-4c16-b4b7-755228dd33e8 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:53.455163 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-38fecdd8-649d-4c16-b4b7-755228dd33e8 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:53.462461 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.compute.server_external_events [req-a31239c0-b01e-4ede-8435-a3243ceb61b1 req-b4ce1c12-2c04-4482-a461-6b86363df78f service nova] Creating event network-vif-plugged:8d31d467-6029-44f7-b3e8-25183019299e for instance 6a4f60d9-b884-40cb-a416-b34e456f77e9 on hv-cinder-maste Oct 19 00:45:53.467927 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-a31239c0-b01e-4ede-8435-a3243ceb61b1 req-b4ce1c12-2c04-4482-a461-6b86363df78f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036170 Oct 19 00:45:53.468571 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 422/828] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:53.586151 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-38fecdd8-649d-4c16-b4b7-755228dd33e8 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:53.588332 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell1:SELECT=100 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:53.595295 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-38fecdd8-649d-4c16-b4b7-755228dd33e8 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859" status: 200 len: 1522 microversion: 2.1 time: 0.156770 Oct 19 00:45:53.595878 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 407/829] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:53 2022] GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:54.461077 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-31be4bab-42aa-4acb-a91d-70e39826fb11 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:54.461702 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-31be4bab-42aa-4acb-a91d-70e39826fb11 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:54.467782 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-31be4bab-42aa-4acb-a91d-70e39826fb11 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:54.468290 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-31be4bab-42aa-4acb-a91d-70e39826fb11 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:54.468719 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-31be4bab-42aa-4acb-a91d-70e39826fb11 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:54.469397 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-31be4bab-42aa-4acb-a91d-70e39826fb11 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:54.469876 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-31be4bab-42aa-4acb-a91d-70e39826fb11 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:54.470295 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-31be4bab-42aa-4acb-a91d-70e39826fb11 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:54.602187 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-31be4bab-42aa-4acb-a91d-70e39826fb11 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:54.609869 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-31be4bab-42aa-4acb-a91d-70e39826fb11 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1258 microversion: 2.1 time: 0.153665 Oct 19 00:45:54.610434 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 423/830] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:54 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:54.621255 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-fcc6362d-f708-466d-bc5a-e95862ad7ce9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:54.621870 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-fcc6362d-f708-466d-bc5a-e95862ad7ce9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4389c416-28bf-4b8e-945e-386f38c16859] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:54.628389 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fcc6362d-f708-466d-bc5a-e95862ad7ce9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:54.628953 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fcc6362d-f708-466d-bc5a-e95862ad7ce9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:54.629585 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fcc6362d-f708-466d-bc5a-e95862ad7ce9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:54.630273 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fcc6362d-f708-466d-bc5a-e95862ad7ce9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:54.630729 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fcc6362d-f708-466d-bc5a-e95862ad7ce9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:54.631154 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fcc6362d-f708-466d-bc5a-e95862ad7ce9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:54.761164 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-fcc6362d-f708-466d-bc5a-e95862ad7ce9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:54.768918 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-fcc6362d-f708-466d-bc5a-e95862ad7ce9 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859" status: 200 len: 1522 microversion: 2.1 time: 0.151488 Oct 19 00:45:54.769643 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 408/831] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:54 2022] GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:55.634268 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-14c35204-b4f3-41e7-bd15-a03f8eb00748 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:55.634877 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-14c35204-b4f3-41e7-bd15-a03f8eb00748 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:55.641416 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-14c35204-b4f3-41e7-bd15-a03f8eb00748 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:55.641906 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-14c35204-b4f3-41e7-bd15-a03f8eb00748 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:55.642479 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-14c35204-b4f3-41e7-bd15-a03f8eb00748 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:55.643187 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-14c35204-b4f3-41e7-bd15-a03f8eb00748 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:55.643643 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-14c35204-b4f3-41e7-bd15-a03f8eb00748 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:55.644127 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-14c35204-b4f3-41e7-bd15-a03f8eb00748 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:55.777854 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-14c35204-b4f3-41e7-bd15-a03f8eb00748 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:55.786225 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-14c35204-b4f3-41e7-bd15-a03f8eb00748 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1258 microversion: 2.1 time: 0.156617 Oct 19 00:45:55.786984 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 424/832] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:55 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:55.792731 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-3b8c970a-bed4-4530-a18f-189663bf320f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:55.793338 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-3b8c970a-bed4-4530-a18f-189663bf320f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4389c416-28bf-4b8e-945e-386f38c16859] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:55.799715 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3b8c970a-bed4-4530-a18f-189663bf320f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:55.800228 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3b8c970a-bed4-4530-a18f-189663bf320f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:55.800752 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3b8c970a-bed4-4530-a18f-189663bf320f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:55.801421 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3b8c970a-bed4-4530-a18f-189663bf320f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:55.801866 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3b8c970a-bed4-4530-a18f-189663bf320f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:55.802316 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3b8c970a-bed4-4530-a18f-189663bf320f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:55.940134 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-3b8c970a-bed4-4530-a18f-189663bf320f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:55.947953 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-3b8c970a-bed4-4530-a18f-189663bf320f tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859" status: 200 len: 1522 microversion: 2.1 time: 0.159231 Oct 19 00:45:55.948523 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 409/833] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:55 2022] GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:56.808947 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-15c4e340-2f2d-45fa-8834-5db5ced4375b tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:56.809555 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-15c4e340-2f2d-45fa-8834-5db5ced4375b tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:56.816623 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-15c4e340-2f2d-45fa-8834-5db5ced4375b tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:56.817112 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-15c4e340-2f2d-45fa-8834-5db5ced4375b tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:56.817575 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-15c4e340-2f2d-45fa-8834-5db5ced4375b tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:56.818256 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-15c4e340-2f2d-45fa-8834-5db5ced4375b tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:56.818704 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-15c4e340-2f2d-45fa-8834-5db5ced4375b tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:56.819126 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-15c4e340-2f2d-45fa-8834-5db5ced4375b tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:56.951771 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-15c4e340-2f2d-45fa-8834-5db5ced4375b tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:56.959548 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-15c4e340-2f2d-45fa-8834-5db5ced4375b tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1258 microversion: 2.1 time: 0.154488 Oct 19 00:45:56.960143 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 425/834] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:56 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:56.970752 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-cd72dc04-8277-4b80-b95d-8b60aab545fd tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:56.971364 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-cd72dc04-8277-4b80-b95d-8b60aab545fd tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4389c416-28bf-4b8e-945e-386f38c16859] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:56.978396 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cd72dc04-8277-4b80-b95d-8b60aab545fd tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:56.978881 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cd72dc04-8277-4b80-b95d-8b60aab545fd tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:56.979321 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cd72dc04-8277-4b80-b95d-8b60aab545fd tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:56.980043 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cd72dc04-8277-4b80-b95d-8b60aab545fd tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:56.980498 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cd72dc04-8277-4b80-b95d-8b60aab545fd tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:56.980924 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cd72dc04-8277-4b80-b95d-8b60aab545fd tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:57.115795 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-cd72dc04-8277-4b80-b95d-8b60aab545fd tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:57.123702 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-cd72dc04-8277-4b80-b95d-8b60aab545fd tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859" status: 200 len: 1522 microversion: 2.1 time: 0.156760 Oct 19 00:45:57.124303 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 410/835] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:56 2022] GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:57.787080 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-c5b652b0-568e-4862-8d00-10f1bb556a74 req-4e14fc63-d5f7-4d67-98f5-bb5d228ca04e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4389c416-28bf-4b8e-945e-386f38c16859", "name": "network-vif-deleted", "tag": "aaf9d032-091b-4318-8721-bd06e12204aa"}]} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:57.796680 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-c5b652b0-568e-4862-8d00-10f1bb556a74 req-4e14fc63-d5f7-4d67-98f5-bb5d228ca04e service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:57.797289 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-c5b652b0-568e-4862-8d00-10f1bb556a74 req-4e14fc63-d5f7-4d67-98f5-bb5d228ca04e service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:57.798111 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-c5b652b0-568e-4862-8d00-10f1bb556a74 req-4e14fc63-d5f7-4d67-98f5-bb5d228ca04e service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:57.815948 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.compute.server_external_events [req-c5b652b0-568e-4862-8d00-10f1bb556a74 req-4e14fc63-d5f7-4d67-98f5-bb5d228ca04e service nova] Creating event network-vif-deleted:aaf9d032-091b-4318-8721-bd06e12204aa for instance 4389c416-28bf-4b8e-945e-386f38c16859 on hv-cinder-maste Oct 19 00:45:57.820999 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-c5b652b0-568e-4862-8d00-10f1bb556a74 req-4e14fc63-d5f7-4d67-98f5-bb5d228ca04e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038553 Oct 19 00:45:57.821612 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 426/836] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:57.983019 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-572341f8-bd98-4393-b036-b3170264fc60 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:57.983543 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-572341f8-bd98-4393-b036-b3170264fc60 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:57.989974 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-572341f8-bd98-4393-b036-b3170264fc60 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:57.990475 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-572341f8-bd98-4393-b036-b3170264fc60 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:57.991156 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-572341f8-bd98-4393-b036-b3170264fc60 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:57.991834 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-572341f8-bd98-4393-b036-b3170264fc60 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:57.992300 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-572341f8-bd98-4393-b036-b3170264fc60 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:57.992717 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-572341f8-bd98-4393-b036-b3170264fc60 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:58.132822 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-572341f8-bd98-4393-b036-b3170264fc60 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:58.140850 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-572341f8-bd98-4393-b036-b3170264fc60 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1442 microversion: 2.1 time: 0.161770 Oct 19 00:45:58.141710 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 411/837] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:57 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1442 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:58.150968 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-d9991be3-2b48-4d48-a693-483d3e06096e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:58.151661 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-d9991be3-2b48-4d48-a693-483d3e06096e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4389c416-28bf-4b8e-945e-386f38c16859] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:58.158725 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d9991be3-2b48-4d48-a693-483d3e06096e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:58.159583 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d9991be3-2b48-4d48-a693-483d3e06096e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:58.160706 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d9991be3-2b48-4d48-a693-483d3e06096e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:58.161509 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d9991be3-2b48-4d48-a693-483d3e06096e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:58.161966 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d9991be3-2b48-4d48-a693-483d3e06096e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:58.162387 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d9991be3-2b48-4d48-a693-483d3e06096e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:58.164906 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-2ffcbdbb-5e53-4726-acd2-2b1370723864 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:58.165761 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-2ffcbdbb-5e53-4726-acd2-2b1370723864 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:58.173430 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2ffcbdbb-5e53-4726-acd2-2b1370723864 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:58.173918 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2ffcbdbb-5e53-4726-acd2-2b1370723864 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:58.174350 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2ffcbdbb-5e53-4726-acd2-2b1370723864 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:58.175044 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2ffcbdbb-5e53-4726-acd2-2b1370723864 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:58.175742 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2ffcbdbb-5e53-4726-acd2-2b1370723864 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:58.176298 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2ffcbdbb-5e53-4726-acd2-2b1370723864 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:58.231770 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-d9991be3-2b48-4d48-a693-483d3e06096e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5628a861c90042d88b95f2d7b898ed52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a230211180742ef9efd4d62b630d211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:58.240259 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-d9991be3-2b48-4d48-a693-483d3e06096e tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859" status: 200 len: 1480 microversion: 2.1 time: 0.093302 Oct 19 00:45:58.240759 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 427/838] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:58 2022] GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859 => generated 1480 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:58.313378 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-2ffcbdbb-5e53-4726-acd2-2b1370723864 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:58.321767 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-2ffcbdbb-5e53-4726-acd2-2b1370723864 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1442 microversion: 2.1 time: 0.161988 Oct 19 00:45:58.322326 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 412/839] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:58 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1442 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:45:59.264040 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-80c94d75-766d-4bf8-953f-d6928376a0c0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:59.264760 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-80c94d75-766d-4bf8-953f-d6928376a0c0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] [instance: 4389c416-28bf-4b8e-945e-386f38c16859] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:59.272401 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-80c94d75-766d-4bf8-953f-d6928376a0c0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:59.272881 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-80c94d75-766d-4bf8-953f-d6928376a0c0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:59.273314 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-80c94d75-766d-4bf8-953f-d6928376a0c0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:59.274005 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-80c94d75-766d-4bf8-953f-d6928376a0c0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:59.274453 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-80c94d75-766d-4bf8-953f-d6928376a0c0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:59.274873 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-80c94d75-766d-4bf8-953f-d6928376a0c0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:59.290720 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.wsgi [None req-80c94d75-766d-4bf8-953f-d6928376a0c0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] HTTP exception thrown: Instance 4389c416-28bf-4b8e-945e-386f38c16859 could not be found. Oct 19 00:45:59.292379 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-80c94d75-766d-4bf8-953f-d6928376a0c0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Request method failure captured: Oct 19 00:45:59.292379 dv-cinder-master-3-smb devstack@n-api.service[125532]: request: GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859 HTTP/1.1 Oct 19 00:45:59.292379 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept: application/json Oct 19 00:45:59.292379 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept-Encoding: identity Oct 19 00:45:59.292379 dv-cinder-master-3-smb devstack@n-api.service[125532]: Connection: close Oct 19 00:45:59.292379 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Length: 0 Oct 19 00:45:59.292379 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Type: application/json Oct 19 00:45:59.292379 dv-cinder-master-3-smb devstack@n-api.service[125532]: Host: 10.222.0.33 Oct 19 00:45:59.292379 dv-cinder-master-3-smb devstack@n-api.service[125532]: Openstack-System-Scope: None Oct 19 00:45:59.292379 dv-cinder-master-3-smb devstack@n-api.service[125532]: User-Agent: python-urllib3/1.26.12 Oct 19 00:45:59.292379 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Auth-Token: gAAAAABjT0dZ_4FF8isbZtl7c5-GdMjgtdkzBRByQoOzSTUxRPm0NU1bMkTSg3nCD_LApNQSolFnUFcfFlewlCxUoOsWoj9qCOzOsCRlZMSRn6X12ufFgLR_KoHBG97yFQ-9UyMgZvW2127GxTVAcAuSg_loWUS1yl5fwx-10demwDus7CXkRQ8 Oct 19 00:45:59.292379 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Id: None Oct 19 00:45:59.292379 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Name: None Oct 19 00:45:59.292379 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Identity-Status: Confirmed Oct 19 00:45:59.292379 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Is-Admin-Project: True Oct 19 00:45:59.292379 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Id: default Oct 19 00:45:59.292379 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Name: Default Oct 19 00:45:59.292379 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Id: 5a230211180742ef9efd4d62b630d211 Oct 19 00:45:59.292379 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-748606272 Oct 19 00:45:59.292379 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Role: member,reader Oct 19 00:45:59.292379 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Roles: member,reader Oct 19 00:45:59.293975 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a230211180742ef9efd4d62b630d211"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a230211180742ef9efd4d62b630d211"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a230211180742ef9efd4d62b630d211"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a230211180742ef9efd4d62b630d211"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:45:59.293975 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant: tempest-ServerRescueNegativeTestJSON-748606272 Oct 19 00:45:59.293975 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Id: 5a230211180742ef9efd4d62b630d211 Oct 19 00:45:59.293975 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-748606272 Oct 19 00:45:59.293975 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User: tempest-ServerRescueNegativeTestJSON-748606272-project Oct 19 00:45:59.293975 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Id: default Oct 19 00:45:59.293975 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Name: Default Oct 19 00:45:59.293975 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Id: 5628a861c90042d88b95f2d7b898ed52 Oct 19 00:45:59.293975 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Name: tempest-ServerRescueNegativeTestJSON-748606272-project Oct 19 00:45:59.293975 dv-cinder-master-3-smb devstack@n-api.service[125532]: method: > Oct 19 00:45:59.293975 dv-cinder-master-3-smb devstack@n-api.service[125532]: exception: Instance 4389c416-28bf-4b8e-945e-386f38c16859 could not be found. Oct 19 00:45:59.293975 dv-cinder-master-3-smb devstack@n-api.service[125532]: action_args: {'id': '4389c416-28bf-4b8e-945e-386f38c16859'} Oct 19 00:45:59.294810 dv-cinder-master-3-smb devstack@n-api.service[125532]: {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:45:59.294810 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:59.294810 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:45:59.294810 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:45:59.294810 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:45:59.294810 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:45:59.294810 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:45:59.294810 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:45:59.294810 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:45:59.294810 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:45:59.294810 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4389c416-28bf-4b8e-945e-386f38c16859 could not be found. Oct 19 00:45:59.294810 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:45:59.294810 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:45:59.294810 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:45:59.294810 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:59.294810 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:45:59.294810 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:45:59.294810 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:45:59.294810 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:45:59.294810 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:45:59.296309 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:45:59.296309 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:45:59.296309 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:45:59.296309 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:45:59.296309 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:45:59.296309 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:45:59.296309 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:45:59.296309 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4389c416-28bf-4b8e-945e-386f38c16859 could not be found. Oct 19 00:45:59.296309 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:45:59.296309 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:45:59.296309 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:45:59.296309 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:59.296309 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:45:59.296309 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:45:59.296309 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:45:59.296309 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:45:59.296309 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4389c416-28bf-4b8e-945e-386f38c16859 could not be found. Oct 19 00:45:59.296309 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:45:59.297748 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-80c94d75-766d-4bf8-953f-d6928376a0c0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] Returning 404 to user: Instance 4389c416-28bf-4b8e-945e-386f38c16859 could not be found. {{(pid=125532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:45:59.297748 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-80c94d75-766d-4bf8-953f-d6928376a0c0 tempest-ServerRescueNegativeTestJSON-748606272 tempest-ServerRescueNegativeTestJSON-748606272-project] 10.222.0.33 "GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859" status: 404 len: 111 microversion: 2.1 time: 0.033630 Oct 19 00:45:59.297748 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 428/840] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:59 2022] GET /compute/v2.1/servers/4389c416-28bf-4b8e-945e-386f38c16859 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 00:46:00.232731 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-962541cc-96a9-47a5-9e21-d21e11f7c74f req-d908ea41-e967-4fa4-8662-68b251fc77c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a4f60d9-b884-40cb-a416-b34e456f77e9", "tag": "8d31d467-6029-44f7-b3e8-25183019299e"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:00.243641 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-962541cc-96a9-47a5-9e21-d21e11f7c74f req-d908ea41-e967-4fa4-8662-68b251fc77c9 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:00.244379 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-962541cc-96a9-47a5-9e21-d21e11f7c74f req-d908ea41-e967-4fa4-8662-68b251fc77c9 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:00.244811 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-962541cc-96a9-47a5-9e21-d21e11f7c74f req-d908ea41-e967-4fa4-8662-68b251fc77c9 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:00.257238 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-962541cc-96a9-47a5-9e21-d21e11f7c74f req-d908ea41-e967-4fa4-8662-68b251fc77c9 service nova] Creating event network-changed:8d31d467-6029-44f7-b3e8-25183019299e for instance 6a4f60d9-b884-40cb-a416-b34e456f77e9 on hv-cinder-maste Oct 19 00:46:00.262975 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-962541cc-96a9-47a5-9e21-d21e11f7c74f req-d908ea41-e967-4fa4-8662-68b251fc77c9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033746 Oct 19 00:46:00.263774 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 413/841] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:20.253817 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-1514e338-ea42-4cc5-ba5c-60b418e1e1d0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:20.255903 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-1514e338-ea42-4cc5-ba5c-60b418e1e1d0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:20.258906 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:20.259545 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:20.267218 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1514e338-ea42-4cc5-ba5c-60b418e1e1d0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:20.267694 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1514e338-ea42-4cc5-ba5c-60b418e1e1d0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:20.268165 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1514e338-ea42-4cc5-ba5c-60b418e1e1d0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:20.268844 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1514e338-ea42-4cc5-ba5c-60b418e1e1d0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:20.269332 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1514e338-ea42-4cc5-ba5c-60b418e1e1d0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:20.269755 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1514e338-ea42-4cc5-ba5c-60b418e1e1d0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:20.301255 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-1514e338-ea42-4cc5-ba5c-60b418e1e1d0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050908 Oct 19 00:46:20.301802 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 429/842] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Oct 19 00:46:20 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:46:20.368276 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:20.369038 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell1:SELECT=33 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:20.373678 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-01090528-5df3-4970-8385-5a3999ac3c1f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:20.374263 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-01090528-5df3-4970-8385-5a3999ac3c1f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:20.381723 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-01090528-5df3-4970-8385-5a3999ac3c1f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:20.382207 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-01090528-5df3-4970-8385-5a3999ac3c1f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:20.382641 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-01090528-5df3-4970-8385-5a3999ac3c1f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:20.383330 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-01090528-5df3-4970-8385-5a3999ac3c1f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:20.383809 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-01090528-5df3-4970-8385-5a3999ac3c1f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:20.384339 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-01090528-5df3-4970-8385-5a3999ac3c1f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:20.409212 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-01090528-5df3-4970-8385-5a3999ac3c1f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Going to try to terminate instance {{(pid=125531) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:46:20.483372 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-01090528-5df3-4970-8385-5a3999ac3c1f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 204 len: 0 microversion: 2.1 time: 0.116822 Oct 19 00:46:20.483989 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 414/843] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Oct 19 00:46:20 2022] DELETE /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:46:20.493246 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-03f05f0c-49e1-4605-a5e3-6a5de65a80e7 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:20.493948 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-03f05f0c-49e1-4605-a5e3-6a5de65a80e7 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:20.499777 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-03f05f0c-49e1-4605-a5e3-6a5de65a80e7 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:20.500299 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-03f05f0c-49e1-4605-a5e3-6a5de65a80e7 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:20.500736 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-03f05f0c-49e1-4605-a5e3-6a5de65a80e7 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:20.501426 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-03f05f0c-49e1-4605-a5e3-6a5de65a80e7 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:20.501880 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-03f05f0c-49e1-4605-a5e3-6a5de65a80e7 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:20.502300 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-03f05f0c-49e1-4605-a5e3-6a5de65a80e7 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:20.655040 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-03f05f0c-49e1-4605-a5e3-6a5de65a80e7 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:20.664084 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-03f05f0c-49e1-4605-a5e3-6a5de65a80e7 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1675 microversion: 2.1 time: 0.175303 Oct 19 00:46:20.664657 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 430/844] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:20 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1675 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:21.689219 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-07b244f0-fc3d-4f95-b9d5-d69abc4f07f8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:21.689926 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-07b244f0-fc3d-4f95-b9d5-d69abc4f07f8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:21.696779 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-07b244f0-fc3d-4f95-b9d5-d69abc4f07f8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:21.697270 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-07b244f0-fc3d-4f95-b9d5-d69abc4f07f8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:21.697710 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-07b244f0-fc3d-4f95-b9d5-d69abc4f07f8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:21.698408 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-07b244f0-fc3d-4f95-b9d5-d69abc4f07f8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:21.698864 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-07b244f0-fc3d-4f95-b9d5-d69abc4f07f8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:21.699026 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-8fbf2fc1-0201-4039-8136-94d7667088f9 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1176245002"}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:21.699445 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-07b244f0-fc3d-4f95-b9d5-d69abc4f07f8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:21.699568 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-8fbf2fc1-0201-4039-8136-94d7667088f9 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:21.705947 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8fbf2fc1-0201-4039-8136-94d7667088f9 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:21.706434 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8fbf2fc1-0201-4039-8136-94d7667088f9 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:21.706904 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8fbf2fc1-0201-4039-8136-94d7667088f9 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:21.707560 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8fbf2fc1-0201-4039-8136-94d7667088f9 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:21.708117 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8fbf2fc1-0201-4039-8136-94d7667088f9 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:21.708539 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8fbf2fc1-0201-4039-8136-94d7667088f9 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:21.845677 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.network.security_group_api [None req-8fbf2fc1-0201-4039-8136-94d7667088f9 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Removing security group 94d61f9d-564e-4042-9c87-019a901b4b14 from port c199c72b-1e56-47e2-b8a5-93c07ba36102 Oct 19 00:46:21.845857 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-07b244f0-fc3d-4f95-b9d5-d69abc4f07f8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:21.854647 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-07b244f0-fc3d-4f95-b9d5-d69abc4f07f8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1675 microversion: 2.1 time: 0.169756 Oct 19 00:46:21.855221 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 415/845] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:21 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:46:22.189177 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-8fbf2fc1-0201-4039-8136-94d7667088f9 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "POST /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4/action" status: 202 len: 0 microversion: 2.1 time: 0.494210 Oct 19 00:46:22.189775 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 431/846] 10.222.0.33 () {60 vars in 1278 bytes} [Wed Oct 19 00:46:21 2022] POST /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4/action => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 00:46:22.201941 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-85ade14d-0654-4e69-9dd2-3564830a4bfd req-734ef978-67a8-4ace-abe2-2cf23dbb9bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09190732-7307-4684-a264-9b5b31301df4", "tag": "c199c72b-1e56-47e2-b8a5-93c07ba36102"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:22.212284 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-85ade14d-0654-4e69-9dd2-3564830a4bfd req-734ef978-67a8-4ace-abe2-2cf23dbb9bb8 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:22.213009 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-85ade14d-0654-4e69-9dd2-3564830a4bfd req-734ef978-67a8-4ace-abe2-2cf23dbb9bb8 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:22.213583 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-85ade14d-0654-4e69-9dd2-3564830a4bfd req-734ef978-67a8-4ace-abe2-2cf23dbb9bb8 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:22.226200 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-85ade14d-0654-4e69-9dd2-3564830a4bfd req-734ef978-67a8-4ace-abe2-2cf23dbb9bb8 service nova] Creating event network-changed:c199c72b-1e56-47e2-b8a5-93c07ba36102 for instance 09190732-7307-4684-a264-9b5b31301df4 on hv-cinder-maste Oct 19 00:46:22.231009 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-85ade14d-0654-4e69-9dd2-3564830a4bfd req-734ef978-67a8-4ace-abe2-2cf23dbb9bb8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034438 Oct 19 00:46:22.232192 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 416/847] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:22.881843 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-6c074f83-35ea-4926-bedd-e11eccde4dff tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:22.882460 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-6c074f83-35ea-4926-bedd-e11eccde4dff tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:22.888840 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6c074f83-35ea-4926-bedd-e11eccde4dff tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:22.889330 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6c074f83-35ea-4926-bedd-e11eccde4dff tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:22.889801 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6c074f83-35ea-4926-bedd-e11eccde4dff tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:22.890776 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6c074f83-35ea-4926-bedd-e11eccde4dff tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:22.892066 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6c074f83-35ea-4926-bedd-e11eccde4dff tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:22.892971 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6c074f83-35ea-4926-bedd-e11eccde4dff tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:23.210046 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-6c074f83-35ea-4926-bedd-e11eccde4dff tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:23.219033 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-6c074f83-35ea-4926-bedd-e11eccde4dff tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 200 len: 1675 microversion: 2.1 time: 0.342383 Oct 19 00:46:23.220119 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 432/848] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:22 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 1675 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:23.298728 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-9d9761b7-639a-450d-8dce-3ed45feddfbd req-d16b4910-ad13-4d9e-a4b2-5553033d314b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f550e071-b7cd-4628-aff9-59e09cfcd654", "name": "network-vif-deleted", "tag": "11a76c21-a751-4ca5-acc2-a510feda4607"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:23.317809 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-9d9761b7-639a-450d-8dce-3ed45feddfbd req-d16b4910-ad13-4d9e-a4b2-5553033d314b service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:23.319125 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-9d9761b7-639a-450d-8dce-3ed45feddfbd req-d16b4910-ad13-4d9e-a4b2-5553033d314b service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:23.319901 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-9d9761b7-639a-450d-8dce-3ed45feddfbd req-d16b4910-ad13-4d9e-a4b2-5553033d314b service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:23.334556 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-9d9761b7-639a-450d-8dce-3ed45feddfbd req-d16b4910-ad13-4d9e-a4b2-5553033d314b service nova] Creating event network-vif-deleted:11a76c21-a751-4ca5-acc2-a510feda4607 for instance f550e071-b7cd-4628-aff9-59e09cfcd654 on hv-cinder-maste Oct 19 00:46:23.341120 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-9d9761b7-639a-450d-8dce-3ed45feddfbd req-d16b4910-ad13-4d9e-a4b2-5553033d314b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046679 Oct 19 00:46:23.342484 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 417/849] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:23.849914 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-c299ebee-269c-462b-8723-b932a722e3b5 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:23.850415 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-c299ebee-269c-462b-8723-b932a722e3b5 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:23.856766 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c299ebee-269c-462b-8723-b932a722e3b5 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:23.857255 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c299ebee-269c-462b-8723-b932a722e3b5 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:23.857688 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c299ebee-269c-462b-8723-b932a722e3b5 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:23.858390 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c299ebee-269c-462b-8723-b932a722e3b5 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:23.859392 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c299ebee-269c-462b-8723-b932a722e3b5 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:23.859485 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c299ebee-269c-462b-8723-b932a722e3b5 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:23.951116 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.objects.instance [None req-c299ebee-269c-462b-8723-b932a722e3b5 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lazy-loading 'services' on Instance uuid 09190732-7307-4684-a264-9b5b31301df4 {{(pid=125532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:46:24.038283 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-c299ebee-269c-462b-8723-b932a722e3b5 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "DELETE /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4/os-volume_attachments/033fe2a7-9161-4635-9b91-34d87246c1dc" status: 202 len: 0 microversion: 2.1 time: 0.192314 Oct 19 00:46:24.039797 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 433/850] 10.222.0.33 () {58 vars in 1416 bytes} [Wed Oct 19 00:46:23 2022] DELETE /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4/os-volume_attachments/033fe2a7-9161-4635-9b91-34d87246c1dc => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:46:24.048428 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-a143eb5a-43ea-453f-b40c-d64455d5ffc4 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:24.050873 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-a143eb5a-43ea-453f-b40c-d64455d5ffc4 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:24.070538 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a143eb5a-43ea-453f-b40c-d64455d5ffc4 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:24.071029 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a143eb5a-43ea-453f-b40c-d64455d5ffc4 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:24.071468 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a143eb5a-43ea-453f-b40c-d64455d5ffc4 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:24.072203 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a143eb5a-43ea-453f-b40c-d64455d5ffc4 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:24.072658 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a143eb5a-43ea-453f-b40c-d64455d5ffc4 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:24.073079 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a143eb5a-43ea-453f-b40c-d64455d5ffc4 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:24.106189 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-a143eb5a-43ea-453f-b40c-d64455d5ffc4 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062101 Oct 19 00:46:24.106768 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 418/851] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Oct 19 00:46:24 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:24.245293 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-f65ee54b-945a-4975-8b01-d4e8ff4ad70e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:24.246202 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-f65ee54b-945a-4975-8b01-d4e8ff4ad70e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:24.247692 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-061814b6-ce55-422a-a7e6-b7d5754ba9bd req-38760a6b-3393-4fe4-87c7-396f3e9b3d39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09190732-7307-4684-a264-9b5b31301df4", "tag": "c199c72b-1e56-47e2-b8a5-93c07ba36102"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:24.254553 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f65ee54b-945a-4975-8b01-d4e8ff4ad70e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:24.255295 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f65ee54b-945a-4975-8b01-d4e8ff4ad70e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:24.255940 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f65ee54b-945a-4975-8b01-d4e8ff4ad70e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:24.256811 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f65ee54b-945a-4975-8b01-d4e8ff4ad70e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:24.257420 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f65ee54b-945a-4975-8b01-d4e8ff4ad70e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:24.258009 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f65ee54b-945a-4975-8b01-d4e8ff4ad70e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:24.260772 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-061814b6-ce55-422a-a7e6-b7d5754ba9bd req-38760a6b-3393-4fe4-87c7-396f3e9b3d39 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:24.261374 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-061814b6-ce55-422a-a7e6-b7d5754ba9bd req-38760a6b-3393-4fe4-87c7-396f3e9b3d39 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:24.261869 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-061814b6-ce55-422a-a7e6-b7d5754ba9bd req-38760a6b-3393-4fe4-87c7-396f3e9b3d39 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:24.273113 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.wsgi [None req-f65ee54b-945a-4975-8b01-d4e8ff4ad70e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] HTTP exception thrown: Instance f550e071-b7cd-4628-aff9-59e09cfcd654 could not be found. Oct 19 00:46:24.275134 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-f65ee54b-945a-4975-8b01-d4e8ff4ad70e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Request method failure captured: Oct 19 00:46:24.275134 dv-cinder-master-3-smb devstack@n-api.service[125532]: request: GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 HTTP/1.1 Oct 19 00:46:24.275134 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept: application/json Oct 19 00:46:24.275134 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept-Encoding: identity Oct 19 00:46:24.275134 dv-cinder-master-3-smb devstack@n-api.service[125532]: Connection: close Oct 19 00:46:24.275134 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Length: 0 Oct 19 00:46:24.275134 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Type: application/json Oct 19 00:46:24.275134 dv-cinder-master-3-smb devstack@n-api.service[125532]: Host: 10.222.0.33 Oct 19 00:46:24.275134 dv-cinder-master-3-smb devstack@n-api.service[125532]: Openstack-System-Scope: None Oct 19 00:46:24.275134 dv-cinder-master-3-smb devstack@n-api.service[125532]: User-Agent: python-urllib3/1.26.12 Oct 19 00:46:24.275134 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Auth-Token: gAAAAABjT0daDvyC8O7kM1DrmURjVrB5Fw-3PywDlM59r2vWGzUCDmQgwbzwn6dqs025_y_VhaMJog77RLJ7YaOVyUqJ64pjZDiX8vT3JzGgx9ggg14vRTQE8O3CWV8o89s6z8biRF1ppb_jgvPfARfc-nlqCyah0Att6gVG_6GRDnlAyaFj9xI Oct 19 00:46:24.275134 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Id: None Oct 19 00:46:24.275134 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Name: None Oct 19 00:46:24.275134 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Identity-Status: Confirmed Oct 19 00:46:24.275134 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Is-Admin-Project: True Oct 19 00:46:24.275134 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Id: default Oct 19 00:46:24.275134 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Name: Default Oct 19 00:46:24.275134 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Id: f150d0c748e54c3eb4943b2b41adb99a Oct 19 00:46:24.275134 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Name: tempest-AttachVolumeTestJSON-1055831001 Oct 19 00:46:24.275134 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Role: member,reader Oct 19 00:46:24.275134 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Roles: member,reader Oct 19 00:46:24.276702 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f150d0c748e54c3eb4943b2b41adb99a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f150d0c748e54c3eb4943b2b41adb99a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f150d0c748e54c3eb4943b2b41adb99a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f150d0c748e54c3eb4943b2b41adb99a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:46:24.276702 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant: tempest-AttachVolumeTestJSON-1055831001 Oct 19 00:46:24.276702 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Id: f150d0c748e54c3eb4943b2b41adb99a Oct 19 00:46:24.276702 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1055831001 Oct 19 00:46:24.276702 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User: tempest-AttachVolumeTestJSON-1055831001-project Oct 19 00:46:24.276702 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Id: default Oct 19 00:46:24.276702 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Name: Default Oct 19 00:46:24.276702 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Id: aacade278860491a9eac6f86b9b2a319 Oct 19 00:46:24.276702 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Name: tempest-AttachVolumeTestJSON-1055831001-project Oct 19 00:46:24.276702 dv-cinder-master-3-smb devstack@n-api.service[125532]: method: > Oct 19 00:46:24.276702 dv-cinder-master-3-smb devstack@n-api.service[125532]: exception: Instance f550e071-b7cd-4628-aff9-59e09cfcd654 could not be found. Oct 19 00:46:24.276702 dv-cinder-master-3-smb devstack@n-api.service[125532]: action_args: {'id': 'f550e071-b7cd-4628-aff9-59e09cfcd654'} Oct 19 00:46:24.277635 dv-cinder-master-3-smb devstack@n-api.service[125532]: {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:46:24.277635 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:24.277635 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:46:24.277635 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:46:24.277635 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:46:24.277635 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:46:24.277635 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:46:24.277635 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:46:24.277635 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:46:24.277635 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:46:24.277635 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f550e071-b7cd-4628-aff9-59e09cfcd654 could not be found. Oct 19 00:46:24.277635 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:46:24.277635 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:24.277635 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:46:24.277635 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:24.277635 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:24.277635 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:24.277635 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:46:24.277635 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:46:24.277635 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:46:24.279247 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:46:24.279247 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:46:24.279247 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:46:24.279247 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:46:24.279247 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:46:24.279247 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:46:24.279247 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:46:24.279247 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f550e071-b7cd-4628-aff9-59e09cfcd654 could not be found. Oct 19 00:46:24.279247 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:46:24.279247 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:24.279247 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:46:24.279247 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:24.279247 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:24.279247 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:24.279247 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:46:24.279247 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:46:24.279247 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f550e071-b7cd-4628-aff9-59e09cfcd654 could not be found. Oct 19 00:46:24.279247 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:46:24.280672 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-061814b6-ce55-422a-a7e6-b7d5754ba9bd req-38760a6b-3393-4fe4-87c7-396f3e9b3d39 service nova] Creating event network-changed:c199c72b-1e56-47e2-b8a5-93c07ba36102 for instance 09190732-7307-4684-a264-9b5b31301df4 on hv-cinder-maste Oct 19 00:46:24.280992 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-f65ee54b-945a-4975-8b01-d4e8ff4ad70e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Returning 404 to user: Instance f550e071-b7cd-4628-aff9-59e09cfcd654 could not be found. {{(pid=125532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:46:24.281867 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-061814b6-ce55-422a-a7e6-b7d5754ba9bd req-38760a6b-3393-4fe4-87c7-396f3e9b3d39 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038179 Oct 19 00:46:24.282208 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-f65ee54b-945a-4975-8b01-d4e8ff4ad70e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 404 len: 111 microversion: 2.1 time: 0.041108 Oct 19 00:46:24.282472 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 419/852] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:24.283576 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 434/853] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:24 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:46:24.293185 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-8ba5ad0b-12b7-4b5e-925e-9e07e7e8e947 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '.version_select at 0x7f81f1294dc0>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:24.327700 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-8ba5ad0b-12b7-4b5e-925e-9e07e7e8e947 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1917852036" status: 202 len: 0 microversion: 2.1 time: 0.038238 Oct 19 00:46:24.328372 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 420/854] 10.222.0.33 () {58 vars in 1221 bytes} [Wed Oct 19 00:46:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1917852036 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:46:25.120878 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-397e0975-33de-4c69-822b-39474956af90 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:25.123832 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-397e0975-33de-4c69-822b-39474956af90 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:25.132127 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-397e0975-33de-4c69-822b-39474956af90 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:25.132676 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-397e0975-33de-4c69-822b-39474956af90 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:25.133148 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-397e0975-33de-4c69-822b-39474956af90 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:25.134071 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-397e0975-33de-4c69-822b-39474956af90 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:25.134683 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-397e0975-33de-4c69-822b-39474956af90 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:25.135305 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-397e0975-33de-4c69-822b-39474956af90 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:25.168148 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-397e0975-33de-4c69-822b-39474956af90 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052076 Oct 19 00:46:25.169382 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 435/855] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Oct 19 00:46:25 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:46:25.180630 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-0fa41036-f5a6-4e07-91d8-180cb87d2be4 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:25.181262 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-0fa41036-f5a6-4e07-91d8-180cb87d2be4 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:25.189578 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0fa41036-f5a6-4e07-91d8-180cb87d2be4 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:25.190073 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0fa41036-f5a6-4e07-91d8-180cb87d2be4 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:25.190544 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0fa41036-f5a6-4e07-91d8-180cb87d2be4 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:25.192280 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0fa41036-f5a6-4e07-91d8-180cb87d2be4 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:25.192735 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0fa41036-f5a6-4e07-91d8-180cb87d2be4 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:25.193164 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0fa41036-f5a6-4e07-91d8-180cb87d2be4 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:25.273024 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.wsgi [None req-0fa41036-f5a6-4e07-91d8-180cb87d2be4 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] HTTP exception thrown: Instance 09190732-7307-4684-a264-9b5b31301df4 is not attached to volume 033fe2a7-9161-4635-9b91-34d87246c1dc Oct 19 00:46:25.275410 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-0fa41036-f5a6-4e07-91d8-180cb87d2be4 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Request method failure captured: Oct 19 00:46:25.275410 dv-cinder-master-3-smb devstack@n-api.service[125531]: request: DELETE /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4/os-volume_attachments/033fe2a7-9161-4635-9b91-34d87246c1dc HTTP/1.1 Oct 19 00:46:25.275410 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept: application/json Oct 19 00:46:25.275410 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept-Encoding: identity Oct 19 00:46:25.275410 dv-cinder-master-3-smb devstack@n-api.service[125531]: Connection: close Oct 19 00:46:25.275410 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Length: 0 Oct 19 00:46:25.275410 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Type: application/json Oct 19 00:46:25.275410 dv-cinder-master-3-smb devstack@n-api.service[125531]: Host: 10.222.0.33 Oct 19 00:46:25.275410 dv-cinder-master-3-smb devstack@n-api.service[125531]: Openstack-System-Scope: None Oct 19 00:46:25.275410 dv-cinder-master-3-smb devstack@n-api.service[125531]: User-Agent: python-urllib3/1.26.12 Oct 19 00:46:25.275410 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Auth-Token: gAAAAABjT0fvTI-xvs_1Wq-SGWZ-GAiu0g6hWORkCYCcg1rvEtc1VQoGn-FAa6tvxbQKhyHDBIUYoK4f-Dg8v-KL1eyyxrPSDKz7t5WUZ1a2-F5WB5vyXSZDOTxAi6HlG-FkITgbSmM7xiEGofXz2rQBluUuWDduJn2ZSKYfmdLlFcIi-NzFgpE Oct 19 00:46:25.275410 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Id: None Oct 19 00:46:25.275410 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Name: None Oct 19 00:46:25.275410 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Identity-Status: Confirmed Oct 19 00:46:25.275410 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Is-Admin-Project: True Oct 19 00:46:25.275410 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Id: default Oct 19 00:46:25.275410 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Name: Default Oct 19 00:46:25.275410 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Id: b8734b79aa064e5b9d04494ca7c5112b Oct 19 00:46:25.275410 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Name: tempest-TestMinimumBasicScenario-1642938842 Oct 19 00:46:25.275410 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Role: member,reader Oct 19 00:46:25.275410 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Roles: member,reader Oct 19 00:46:25.277002 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b8734b79aa064e5b9d04494ca7c5112b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b8734b79aa064e5b9d04494ca7c5112b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b8734b79aa064e5b9d04494ca7c5112b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b8734b79aa064e5b9d04494ca7c5112b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:46:25.277002 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant: tempest-TestMinimumBasicScenario-1642938842 Oct 19 00:46:25.277002 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Id: b8734b79aa064e5b9d04494ca7c5112b Oct 19 00:46:25.277002 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1642938842 Oct 19 00:46:25.277002 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User: tempest-TestMinimumBasicScenario-1642938842-project Oct 19 00:46:25.277002 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Id: default Oct 19 00:46:25.277002 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Name: Default Oct 19 00:46:25.277002 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Id: 53358104a2534d9084e19ca4ae59816e Oct 19 00:46:25.277002 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Name: tempest-TestMinimumBasicScenario-1642938842-project Oct 19 00:46:25.277002 dv-cinder-master-3-smb devstack@n-api.service[125531]: method: > Oct 19 00:46:25.277002 dv-cinder-master-3-smb devstack@n-api.service[125531]: exception: Instance 09190732-7307-4684-a264-9b5b31301df4 is not attached to volume 033fe2a7-9161-4635-9b91-34d87246c1dc Oct 19 00:46:25.278399 dv-cinder-master-3-smb devstack@n-api.service[125531]: action_args: {'server_id': '09190732-7307-4684-a264-9b5b31301df4', 'id': '033fe2a7-9161-4635-9b91-34d87246c1dc'} Oct 19 00:46:25.278399 dv-cinder-master-3-smb devstack@n-api.service[125531]: {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:46:25.278399 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:25.278399 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 19 00:46:25.278399 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 19 00:46:25.278399 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 00:46:25.278399 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 00:46:25.278399 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 19 00:46:25.278399 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 19 00:46:25.278399 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 033fe2a7-9161-4635-9b91-34d87246c1dc. Oct 19 00:46:25.278399 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:46:25.278399 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:25.278399 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:46:25.278399 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:25.278399 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:25.278399 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:25.278399 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:46:25.278399 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:46:25.278399 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:46:25.280266 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:46:25.280266 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 19 00:46:25.280266 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 00:46:25.280266 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09190732-7307-4684-a264-9b5b31301df4 is not attached to volume 033fe2a7-9161-4635-9b91-34d87246c1dc Oct 19 00:46:25.280266 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:46:25.280266 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:25.280266 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:46:25.280266 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:25.280266 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:25.280266 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:25.280266 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:46:25.280266 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:46:25.280266 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09190732-7307-4684-a264-9b5b31301df4 is not attached to volume 033fe2a7-9161-4635-9b91-34d87246c1dc Oct 19 00:46:25.280266 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:46:25.280266 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-0fa41036-f5a6-4e07-91d8-180cb87d2be4 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Returning 404 to user: Instance 09190732-7307-4684-a264-9b5b31301df4 is not attached to volume 033fe2a7-9161-4635-9b91-34d87246c1dc {{(pid=125531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:46:25.281945 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-0fa41036-f5a6-4e07-91d8-180cb87d2be4 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "DELETE /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4/os-volume_attachments/033fe2a7-9161-4635-9b91-34d87246c1dc" status: 404 len: 154 microversion: 2.1 time: 0.100659 Oct 19 00:46:25.281945 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 421/856] 10.222.0.33 () {58 vars in 1416 bytes} [Wed Oct 19 00:46:25 2022] DELETE /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4/os-volume_attachments/033fe2a7-9161-4635-9b91-34d87246c1dc => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 00:46:25.642370 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-b2e2c4bc-9470-4f3a-838d-d01a4c27a702 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Action: 'create', calling method: .version_select at 0x7f81f0e7cdc0>, body: {"keypair": {"name": "tempest-keypair-951521140", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBPRzzDZLASkdDXYQzQKjFOCGpAOa/ElqKfQgHca7cbMilJj7YSbdKhO1ikgaCmIFkqVMGJVS2JL3PSdN97qqJOrjN852dqfrTMVhQk3+itCZZ8hgPnyG9HAfyAzdtvBw=="}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:25.658805 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.quota [None req-b2e2c4bc-9470-4f3a-838d-d01a4c27a702 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Getting quotas for project f150d0c748e54c3eb4943b2b41adb99a. Resources: {'key_pairs'} {{(pid=125532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:46:25.662705 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.quota [None req-b2e2c4bc-9470-4f3a-838d-d01a4c27a702 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Getting quotas for user aacade278860491a9eac6f86b9b2a319 and project f150d0c748e54c3eb4943b2b41adb99a. Resources: {'key_pairs'} {{(pid=125532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:46:25.687937 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-b2e2c4bc-9470-4f3a-838d-d01a4c27a702 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049487 Oct 19 00:46:25.688755 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 436/857] 10.222.0.33 () {60 vars in 1159 bytes} [Wed Oct 19 00:46:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:26.434854 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-9ea8db7c-4cb1-414d-804e-13017f7c5df9 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:26.435385 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-9ea8db7c-4cb1-414d-804e-13017f7c5df9 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:26.442266 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9ea8db7c-4cb1-414d-804e-13017f7c5df9 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:26.442767 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9ea8db7c-4cb1-414d-804e-13017f7c5df9 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:26.443190 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9ea8db7c-4cb1-414d-804e-13017f7c5df9 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:26.443921 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9ea8db7c-4cb1-414d-804e-13017f7c5df9 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:26.444380 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9ea8db7c-4cb1-414d-804e-13017f7c5df9 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:26.444803 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9ea8db7c-4cb1-414d-804e-13017f7c5df9 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:26.470956 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-9ea8db7c-4cb1-414d-804e-13017f7c5df9 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Going to try to terminate instance {{(pid=125531) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:46:26.551823 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-9ea8db7c-4cb1-414d-804e-13017f7c5df9 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "DELETE /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 204 len: 0 microversion: 2.1 time: 0.120250 Oct 19 00:46:26.552715 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 422/858] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Oct 19 00:46:26 2022] DELETE /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:46:26.561411 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-5afd8615-51ff-42b8-9b75-3313a59e47b6 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:26.562028 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-5afd8615-51ff-42b8-9b75-3313a59e47b6 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:26.568156 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5afd8615-51ff-42b8-9b75-3313a59e47b6 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:26.568642 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5afd8615-51ff-42b8-9b75-3313a59e47b6 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:26.569079 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5afd8615-51ff-42b8-9b75-3313a59e47b6 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:26.569772 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5afd8615-51ff-42b8-9b75-3313a59e47b6 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:26.570227 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5afd8615-51ff-42b8-9b75-3313a59e47b6 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:26.570649 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5afd8615-51ff-42b8-9b75-3313a59e47b6 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:26.709760 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-5afd8615-51ff-42b8-9b75-3313a59e47b6 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:26.717600 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-5afd8615-51ff-42b8-9b75-3313a59e47b6 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1554 microversion: 2.1 time: 0.160537 Oct 19 00:46:26.718169 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 437/859] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:26 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:27.017695 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-01e4aeb6-45d9-4d3b-bfea-1b01a60c389b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-174130213", "imageRef": "d1f4abc9-3bb9-4343-9a05-53d758070c9d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ee4d8b37-3c72-450e-867b-ee9fb1ac3254"}], "security_groups": [{"name": "tempest-securitygroup--1774359375"}], "key_name": "tempest-keypair-951521140", "user_data": "}} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:27.131044 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.network.neutron [None req-01e4aeb6-45d9-4d3b-bfea-1b01a60c389b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] validate_networks() for [('ee4d8b37-3c72-450e-867b-ee9fb1ac3254', None, None, None, None, None)] {{(pid=125531) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:46:27.510574 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-01e4aeb6-45d9-4d3b-bfea-1b01a60c389b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Flavor limits 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:46:27.511131 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-01e4aeb6-45d9-4d3b-bfea-1b01a60c389b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Image limits 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:46:27.511520 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-01e4aeb6-45d9-4d3b-bfea-1b01a60c389b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Flavor pref 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:46:27.511959 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-01e4aeb6-45d9-4d3b-bfea-1b01a60c389b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Image pref 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:46:27.512375 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-01e4aeb6-45d9-4d3b-bfea-1b01a60c389b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:46:27.521826 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-01e4aeb6-45d9-4d3b-bfea-1b01a60c389b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:27.522310 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-01e4aeb6-45d9-4d3b-bfea-1b01a60c389b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:27.522899 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-01e4aeb6-45d9-4d3b-bfea-1b01a60c389b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:27.523640 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-01e4aeb6-45d9-4d3b-bfea-1b01a60c389b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:27.524189 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-01e4aeb6-45d9-4d3b-bfea-1b01a60c389b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:27.524621 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-01e4aeb6-45d9-4d3b-bfea-1b01a60c389b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:27.542542 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.quota [None req-01e4aeb6-45d9-4d3b-bfea-1b01a60c389b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Getting quotas for project f150d0c748e54c3eb4943b2b41adb99a. Resources: {'instances', 'cores', 'ram'} {{(pid=125531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:46:27.546741 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.quota [None req-01e4aeb6-45d9-4d3b-bfea-1b01a60c389b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Getting quotas for user aacade278860491a9eac6f86b9b2a319 and project f150d0c748e54c3eb4943b2b41adb99a. Resources: {'instances', 'cores', 'ram'} {{(pid=125531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:46:27.558063 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-01e4aeb6-45d9-4d3b-bfea-1b01a60c389b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Going to run 1 instances... {{(pid=125531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:46:27.560479 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-01e4aeb6-45d9-4d3b-bfea-1b01a60c389b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: 79139e42-0238-4e80-8a53-b00cb59e03f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1f4abc9-3bb9-4343-9a05-53d758070c9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:46:27.609122 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-01e4aeb6-45d9-4d3b-bfea-1b01a60c389b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.597062 Oct 19 00:46:27.609975 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 423/860] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Oct 19 00:46:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:46:27.621498 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-b12ba5b3-cf5e-43cc-98df-b9fd6660c7db tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:27.622105 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-b12ba5b3-cf5e-43cc-98df-b9fd6660c7db tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: 79139e42-0238-4e80-8a53-b00cb59e03f0] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:27.676186 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-b12ba5b3-cf5e-43cc-98df-b9fd6660c7db tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:27.682984 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-b12ba5b3-cf5e-43cc-98df-b9fd6660c7db tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0" status: 200 len: 1236 microversion: 2.1 time: 0.065474 Oct 19 00:46:27.683547 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 438/861] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:27 2022] GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0 => generated 1236 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:27.740840 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-f5a94e77-0eae-4276-9650-17662148eb30 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:27.741480 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-f5a94e77-0eae-4276-9650-17662148eb30 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:27.747686 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f5a94e77-0eae-4276-9650-17662148eb30 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:27.748198 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f5a94e77-0eae-4276-9650-17662148eb30 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:27.748729 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f5a94e77-0eae-4276-9650-17662148eb30 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:27.749424 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f5a94e77-0eae-4276-9650-17662148eb30 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:27.750137 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f5a94e77-0eae-4276-9650-17662148eb30 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:27.750280 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f5a94e77-0eae-4276-9650-17662148eb30 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:27.889457 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-f5a94e77-0eae-4276-9650-17662148eb30 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:27.898682 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-f5a94e77-0eae-4276-9650-17662148eb30 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1554 microversion: 2.1 time: 0.161689 Oct 19 00:46:27.899250 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 424/862] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:27 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:28.707230 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-9df8d525-ee40-4492-8ac5-93b26c82013d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:28.708267 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-9df8d525-ee40-4492-8ac5-93b26c82013d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: 79139e42-0238-4e80-8a53-b00cb59e03f0] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:28.715212 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9df8d525-ee40-4492-8ac5-93b26c82013d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:28.715908 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9df8d525-ee40-4492-8ac5-93b26c82013d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:28.716357 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9df8d525-ee40-4492-8ac5-93b26c82013d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:28.717059 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9df8d525-ee40-4492-8ac5-93b26c82013d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:28.717539 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9df8d525-ee40-4492-8ac5-93b26c82013d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:28.717932 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9df8d525-ee40-4492-8ac5-93b26c82013d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:28.782240 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-9df8d525-ee40-4492-8ac5-93b26c82013d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:28.790862 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-9df8d525-ee40-4492-8ac5-93b26c82013d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0" status: 200 len: 1288 microversion: 2.1 time: 0.088327 Oct 19 00:46:28.791413 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 439/863] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:28 2022] GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0 => generated 1288 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:28.922414 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-a709d1ac-3cac-4420-a721-236ea1774315 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:28.923029 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-a709d1ac-3cac-4420-a721-236ea1774315 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:28.929505 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a709d1ac-3cac-4420-a721-236ea1774315 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:28.929986 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a709d1ac-3cac-4420-a721-236ea1774315 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:28.930428 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a709d1ac-3cac-4420-a721-236ea1774315 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:28.931119 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a709d1ac-3cac-4420-a721-236ea1774315 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:28.931578 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a709d1ac-3cac-4420-a721-236ea1774315 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:28.932034 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a709d1ac-3cac-4420-a721-236ea1774315 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:29.059586 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-a709d1ac-3cac-4420-a721-236ea1774315 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:29.068059 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-a709d1ac-3cac-4420-a721-236ea1774315 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1554 microversion: 2.1 time: 0.149579 Oct 19 00:46:29.068641 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 425/864] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:28 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:29.697412 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-e90f32cc-02dd-42dc-9fb9-ccae715733dc req-9f3c923e-9f57-4ca5-a160-c88e4db3eabe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09190732-7307-4684-a264-9b5b31301df4", "name": "network-vif-deleted", "tag": "c199c72b-1e56-47e2-b8a5-93c07ba36102"}]} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:29.715378 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-e90f32cc-02dd-42dc-9fb9-ccae715733dc req-9f3c923e-9f57-4ca5-a160-c88e4db3eabe service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:29.716451 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-e90f32cc-02dd-42dc-9fb9-ccae715733dc req-9f3c923e-9f57-4ca5-a160-c88e4db3eabe service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:29.716878 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-e90f32cc-02dd-42dc-9fb9-ccae715733dc req-9f3c923e-9f57-4ca5-a160-c88e4db3eabe service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:29.733421 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.compute.server_external_events [req-e90f32cc-02dd-42dc-9fb9-ccae715733dc req-9f3c923e-9f57-4ca5-a160-c88e4db3eabe service nova] Creating event network-vif-deleted:c199c72b-1e56-47e2-b8a5-93c07ba36102 for instance 09190732-7307-4684-a264-9b5b31301df4 on hv-cinder-maste Oct 19 00:46:29.739662 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-e90f32cc-02dd-42dc-9fb9-ccae715733dc req-9f3c923e-9f57-4ca5-a160-c88e4db3eabe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046135 Oct 19 00:46:29.741197 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 440/865] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:29.813380 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-5ebb8ae6-c93b-4725-bb81-69269e2b6c4e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:29.814021 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-5ebb8ae6-c93b-4725-bb81-69269e2b6c4e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: 79139e42-0238-4e80-8a53-b00cb59e03f0] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:29.822051 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5ebb8ae6-c93b-4725-bb81-69269e2b6c4e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:29.822771 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5ebb8ae6-c93b-4725-bb81-69269e2b6c4e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:29.823207 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5ebb8ae6-c93b-4725-bb81-69269e2b6c4e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:29.823921 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5ebb8ae6-c93b-4725-bb81-69269e2b6c4e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:29.824375 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5ebb8ae6-c93b-4725-bb81-69269e2b6c4e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:29.824794 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5ebb8ae6-c93b-4725-bb81-69269e2b6c4e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:29.909726 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-5ebb8ae6-c93b-4725-bb81-69269e2b6c4e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:29.920104 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-5ebb8ae6-c93b-4725-bb81-69269e2b6c4e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0" status: 200 len: 1294 microversion: 2.1 time: 0.110209 Oct 19 00:46:29.929062 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 426/866] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:29 2022] GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0 => generated 1294 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:30.091770 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-0bcc0e0a-18e1-47be-9b9b-ef0213527483 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:30.092791 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-0bcc0e0a-18e1-47be-9b9b-ef0213527483 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:30.102212 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0bcc0e0a-18e1-47be-9b9b-ef0213527483 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:30.103374 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0bcc0e0a-18e1-47be-9b9b-ef0213527483 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:30.103916 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0bcc0e0a-18e1-47be-9b9b-ef0213527483 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:30.104823 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0bcc0e0a-18e1-47be-9b9b-ef0213527483 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:30.105607 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0bcc0e0a-18e1-47be-9b9b-ef0213527483 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:30.106477 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0bcc0e0a-18e1-47be-9b9b-ef0213527483 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:30.147468 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0bcc0e0a-18e1-47be-9b9b-ef0213527483 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:30.148843 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0bcc0e0a-18e1-47be-9b9b-ef0213527483 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:30.149499 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0bcc0e0a-18e1-47be-9b9b-ef0213527483 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:30.150140 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.objects.instance [None req-0bcc0e0a-18e1-47be-9b9b-ef0213527483 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lazy-loading 'fault' on Instance uuid 09190732-7307-4684-a264-9b5b31301df4 {{(pid=125532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:46:30.202535 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-0bcc0e0a-18e1-47be-9b9b-ef0213527483 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53358104a2534d9084e19ca4ae59816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8734b79aa064e5b9d04494ca7c5112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:30.213208 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-0bcc0e0a-18e1-47be-9b9b-ef0213527483 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 200 len: 1349 microversion: 2.1 time: 0.125759 Oct 19 00:46:30.220256 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 441/867] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:30 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 1349 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:30.945218 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-49ab581b-8bcd-427a-b1fb-bdef3e17db6e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:30.945945 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-49ab581b-8bcd-427a-b1fb-bdef3e17db6e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: 79139e42-0238-4e80-8a53-b00cb59e03f0] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:30.952464 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-49ab581b-8bcd-427a-b1fb-bdef3e17db6e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:30.952949 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-49ab581b-8bcd-427a-b1fb-bdef3e17db6e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:30.953379 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-49ab581b-8bcd-427a-b1fb-bdef3e17db6e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:30.954074 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-49ab581b-8bcd-427a-b1fb-bdef3e17db6e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:30.954525 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-49ab581b-8bcd-427a-b1fb-bdef3e17db6e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:30.954952 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-49ab581b-8bcd-427a-b1fb-bdef3e17db6e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:31.237492 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-285334ea-d12d-4c0d-93d7-ec69174fec95 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:31.238832 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-285334ea-d12d-4c0d-93d7-ec69174fec95 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] [instance: 09190732-7307-4684-a264-9b5b31301df4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:31.245982 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-285334ea-d12d-4c0d-93d7-ec69174fec95 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:31.246465 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-285334ea-d12d-4c0d-93d7-ec69174fec95 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:31.246899 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-285334ea-d12d-4c0d-93d7-ec69174fec95 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:31.247599 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-285334ea-d12d-4c0d-93d7-ec69174fec95 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:31.248094 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-285334ea-d12d-4c0d-93d7-ec69174fec95 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:31.248522 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-285334ea-d12d-4c0d-93d7-ec69174fec95 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:31.263299 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.wsgi [None req-285334ea-d12d-4c0d-93d7-ec69174fec95 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] HTTP exception thrown: Instance 09190732-7307-4684-a264-9b5b31301df4 could not be found. Oct 19 00:46:31.265004 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-285334ea-d12d-4c0d-93d7-ec69174fec95 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Request method failure captured: Oct 19 00:46:31.265004 dv-cinder-master-3-smb devstack@n-api.service[125532]: request: GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 HTTP/1.1 Oct 19 00:46:31.265004 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept: application/json Oct 19 00:46:31.265004 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept-Encoding: identity Oct 19 00:46:31.265004 dv-cinder-master-3-smb devstack@n-api.service[125532]: Connection: close Oct 19 00:46:31.265004 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Length: 0 Oct 19 00:46:31.265004 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Type: application/json Oct 19 00:46:31.265004 dv-cinder-master-3-smb devstack@n-api.service[125532]: Host: 10.222.0.33 Oct 19 00:46:31.265004 dv-cinder-master-3-smb devstack@n-api.service[125532]: Openstack-System-Scope: None Oct 19 00:46:31.265004 dv-cinder-master-3-smb devstack@n-api.service[125532]: User-Agent: python-urllib3/1.26.12 Oct 19 00:46:31.265004 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Auth-Token: gAAAAABjT0fvTI-xvs_1Wq-SGWZ-GAiu0g6hWORkCYCcg1rvEtc1VQoGn-FAa6tvxbQKhyHDBIUYoK4f-Dg8v-KL1eyyxrPSDKz7t5WUZ1a2-F5WB5vyXSZDOTxAi6HlG-FkITgbSmM7xiEGofXz2rQBluUuWDduJn2ZSKYfmdLlFcIi-NzFgpE Oct 19 00:46:31.265004 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Id: None Oct 19 00:46:31.265004 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Name: None Oct 19 00:46:31.265004 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Identity-Status: Confirmed Oct 19 00:46:31.265004 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Is-Admin-Project: True Oct 19 00:46:31.265004 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Id: default Oct 19 00:46:31.265004 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Name: Default Oct 19 00:46:31.265004 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Id: b8734b79aa064e5b9d04494ca7c5112b Oct 19 00:46:31.265004 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Name: tempest-TestMinimumBasicScenario-1642938842 Oct 19 00:46:31.265004 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Role: member,reader Oct 19 00:46:31.265004 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Roles: member,reader Oct 19 00:46:31.266621 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b8734b79aa064e5b9d04494ca7c5112b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b8734b79aa064e5b9d04494ca7c5112b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b8734b79aa064e5b9d04494ca7c5112b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b8734b79aa064e5b9d04494ca7c5112b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:46:31.266621 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant: tempest-TestMinimumBasicScenario-1642938842 Oct 19 00:46:31.266621 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Id: b8734b79aa064e5b9d04494ca7c5112b Oct 19 00:46:31.266621 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1642938842 Oct 19 00:46:31.266621 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User: tempest-TestMinimumBasicScenario-1642938842-project Oct 19 00:46:31.266621 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Id: default Oct 19 00:46:31.266621 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Name: Default Oct 19 00:46:31.266621 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Id: 53358104a2534d9084e19ca4ae59816e Oct 19 00:46:31.266621 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Name: tempest-TestMinimumBasicScenario-1642938842-project Oct 19 00:46:31.266621 dv-cinder-master-3-smb devstack@n-api.service[125532]: method: > Oct 19 00:46:31.266621 dv-cinder-master-3-smb devstack@n-api.service[125532]: exception: Instance 09190732-7307-4684-a264-9b5b31301df4 could not be found. Oct 19 00:46:31.266621 dv-cinder-master-3-smb devstack@n-api.service[125532]: action_args: {'id': '09190732-7307-4684-a264-9b5b31301df4'} Oct 19 00:46:31.267431 dv-cinder-master-3-smb devstack@n-api.service[125532]: {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:46:31.267431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:31.267431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:46:31.267431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:46:31.267431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:46:31.267431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:46:31.267431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:46:31.267431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:46:31.267431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:46:31.267431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:46:31.267431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09190732-7307-4684-a264-9b5b31301df4 could not be found. Oct 19 00:46:31.267431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:46:31.267431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:31.267431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:46:31.267431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:31.267431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:31.267431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:31.267431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:46:31.267431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:46:31.267431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:46:31.268843 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:46:31.268843 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:46:31.268843 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:46:31.268843 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:46:31.268843 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:46:31.268843 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:46:31.268843 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:46:31.268843 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09190732-7307-4684-a264-9b5b31301df4 could not be found. Oct 19 00:46:31.268843 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:46:31.268843 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:31.268843 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:46:31.268843 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:31.268843 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:31.268843 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:31.268843 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:46:31.268843 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:46:31.268843 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09190732-7307-4684-a264-9b5b31301df4 could not be found. Oct 19 00:46:31.268843 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:46:31.270695 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-285334ea-d12d-4c0d-93d7-ec69174fec95 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Returning 404 to user: Instance 09190732-7307-4684-a264-9b5b31301df4 could not be found. {{(pid=125532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:46:31.270695 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-285334ea-d12d-4c0d-93d7-ec69174fec95 tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4" status: 404 len: 111 microversion: 2.1 time: 0.032842 Oct 19 00:46:31.270695 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 442/868] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:31 2022] GET /compute/v2.1/servers/09190732-7307-4684-a264-9b5b31301df4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 00:46:31.275509 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-c5ea9452-fa3d-4a14-998e-60f23c98c32e tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] Calling method '.version_select at 0x7f81f0f65dc0>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:31.294685 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-c5ea9452-fa3d-4a14-998e-60f23c98c32e tempest-TestMinimumBasicScenario-1642938842 tempest-TestMinimumBasicScenario-1642938842-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1925025160" status: 202 len: 0 microversion: 2.1 time: 0.022701 Oct 19 00:46:31.295520 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 443/869] 10.222.0.33 () {58 vars in 1272 bytes} [Wed Oct 19 00:46:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1925025160 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 00:46:31.445810 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-49ab581b-8bcd-427a-b1fb-bdef3e17db6e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:31.454407 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-49ab581b-8bcd-427a-b1fb-bdef3e17db6e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0" status: 200 len: 1362 microversion: 2.1 time: 0.513385 Oct 19 00:46:31.455135 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 427/870] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:30 2022] GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0 => generated 1362 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:31.510242 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-0b035676-2c6d-47a4-b3a2-968029ae23c4 req-48fab3b8-e61b-44bd-9edc-c6f4ffb2a3dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79139e42-0238-4e80-8a53-b00cb59e03f0", "tag": "04cb5aa4-0534-4cce-9ce2-bdd3bc7a0f42"}]} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:31.524523 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-0b035676-2c6d-47a4-b3a2-968029ae23c4 req-48fab3b8-e61b-44bd-9edc-c6f4ffb2a3dd service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:31.525192 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-0b035676-2c6d-47a4-b3a2-968029ae23c4 req-48fab3b8-e61b-44bd-9edc-c6f4ffb2a3dd service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:31.525913 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-0b035676-2c6d-47a4-b3a2-968029ae23c4 req-48fab3b8-e61b-44bd-9edc-c6f4ffb2a3dd service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:31.540365 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.compute.server_external_events [req-0b035676-2c6d-47a4-b3a2-968029ae23c4 req-48fab3b8-e61b-44bd-9edc-c6f4ffb2a3dd service nova] Creating event network-changed:04cb5aa4-0534-4cce-9ce2-bdd3bc7a0f42 for instance 79139e42-0238-4e80-8a53-b00cb59e03f0 on hv-cinder-maste Oct 19 00:46:31.547037 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-0b035676-2c6d-47a4-b3a2-968029ae23c4 req-48fab3b8-e61b-44bd-9edc-c6f4ffb2a3dd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040420 Oct 19 00:46:31.548048 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 444/871] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:32.482888 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-d272b16f-e332-47dc-81f3-cc68ca0de1b2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:32.483500 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-d272b16f-e332-47dc-81f3-cc68ca0de1b2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: 79139e42-0238-4e80-8a53-b00cb59e03f0] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:32.491111 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d272b16f-e332-47dc-81f3-cc68ca0de1b2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:32.491591 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d272b16f-e332-47dc-81f3-cc68ca0de1b2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:32.492304 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d272b16f-e332-47dc-81f3-cc68ca0de1b2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:32.493118 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d272b16f-e332-47dc-81f3-cc68ca0de1b2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:32.493762 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d272b16f-e332-47dc-81f3-cc68ca0de1b2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:32.494418 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d272b16f-e332-47dc-81f3-cc68ca0de1b2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:32.775568 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-d272b16f-e332-47dc-81f3-cc68ca0de1b2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:32.785195 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-d272b16f-e332-47dc-81f3-cc68ca0de1b2 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0" status: 200 len: 1362 microversion: 2.1 time: 0.306066 Oct 19 00:46:32.786202 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 428/872] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:32 2022] GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0 => generated 1362 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:33.809754 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-9b0f8f86-341a-4ccb-ad66-ff6077d926e0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:33.811112 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-9b0f8f86-341a-4ccb-ad66-ff6077d926e0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: 79139e42-0238-4e80-8a53-b00cb59e03f0] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:33.819825 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9b0f8f86-341a-4ccb-ad66-ff6077d926e0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:33.820734 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9b0f8f86-341a-4ccb-ad66-ff6077d926e0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:33.821275 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9b0f8f86-341a-4ccb-ad66-ff6077d926e0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:33.822200 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9b0f8f86-341a-4ccb-ad66-ff6077d926e0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:33.822919 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9b0f8f86-341a-4ccb-ad66-ff6077d926e0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:33.823550 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9b0f8f86-341a-4ccb-ad66-ff6077d926e0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:34.056090 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-9b0f8f86-341a-4ccb-ad66-ff6077d926e0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:34.067924 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-9b0f8f86-341a-4ccb-ad66-ff6077d926e0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0" status: 200 len: 1362 microversion: 2.1 time: 0.262868 Oct 19 00:46:34.068576 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 445/873] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:33 2022] GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0 => generated 1362 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:35.090970 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-32fe2ced-d386-4435-ba4b-512148d5921c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:35.092336 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-32fe2ced-d386-4435-ba4b-512148d5921c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: 79139e42-0238-4e80-8a53-b00cb59e03f0] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:35.099994 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-32fe2ced-d386-4435-ba4b-512148d5921c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:35.100615 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-32fe2ced-d386-4435-ba4b-512148d5921c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:35.101325 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-32fe2ced-d386-4435-ba4b-512148d5921c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:35.102251 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-32fe2ced-d386-4435-ba4b-512148d5921c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:35.102802 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-32fe2ced-d386-4435-ba4b-512148d5921c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:35.103342 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-32fe2ced-d386-4435-ba4b-512148d5921c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:35.675381 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-32fe2ced-d386-4435-ba4b-512148d5921c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:35.705884 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-32fe2ced-d386-4435-ba4b-512148d5921c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0" status: 200 len: 1362 microversion: 2.1 time: 0.619047 Oct 19 00:46:35.709871 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 429/874] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:35 2022] GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0 => generated 1362 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:36.729748 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-fca499ce-4691-4967-a537-a0682f36f656 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:36.730302 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-fca499ce-4691-4967-a537-a0682f36f656 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: 79139e42-0238-4e80-8a53-b00cb59e03f0] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:36.736871 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-fca499ce-4691-4967-a537-a0682f36f656 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:36.737468 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-fca499ce-4691-4967-a537-a0682f36f656 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:36.738381 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-fca499ce-4691-4967-a537-a0682f36f656 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:36.739432 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-fca499ce-4691-4967-a537-a0682f36f656 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:36.739905 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-fca499ce-4691-4967-a537-a0682f36f656 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:36.740490 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-fca499ce-4691-4967-a537-a0682f36f656 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:36.884193 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-fca499ce-4691-4967-a537-a0682f36f656 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:36.893123 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-fca499ce-4691-4967-a537-a0682f36f656 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0" status: 200 len: 1362 microversion: 2.1 time: 0.167502 Oct 19 00:46:36.894090 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 446/875] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:36 2022] GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:37.433303 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-e76d52ce-5409-4383-bb88-3b329fcf9e81 req-d9e9f5e8-2886-4e88-9f5a-7ae0d8fcb86e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79139e42-0238-4e80-8a53-b00cb59e03f0", "name": "network-vif-plugged", "status": "completed", "tag": "04cb5aa4-0534-4cce-9ce2-bdd3bc7a0f42"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:37.445098 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-e76d52ce-5409-4383-bb88-3b329fcf9e81 req-d9e9f5e8-2886-4e88-9f5a-7ae0d8fcb86e service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:37.445862 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-e76d52ce-5409-4383-bb88-3b329fcf9e81 req-d9e9f5e8-2886-4e88-9f5a-7ae0d8fcb86e service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:37.446518 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-e76d52ce-5409-4383-bb88-3b329fcf9e81 req-d9e9f5e8-2886-4e88-9f5a-7ae0d8fcb86e service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:37.459721 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-e76d52ce-5409-4383-bb88-3b329fcf9e81 req-d9e9f5e8-2886-4e88-9f5a-7ae0d8fcb86e service nova] Creating event network-vif-plugged:04cb5aa4-0534-4cce-9ce2-bdd3bc7a0f42 for instance 79139e42-0238-4e80-8a53-b00cb59e03f0 on hv-cinder-maste Oct 19 00:46:37.465786 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-e76d52ce-5409-4383-bb88-3b329fcf9e81 req-d9e9f5e8-2886-4e88-9f5a-7ae0d8fcb86e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036110 Oct 19 00:46:37.467195 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 430/876] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:37.921455 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-3b576514-f4b5-42d8-b7a4-c8cc57b31db8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:37.923482 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-3b576514-f4b5-42d8-b7a4-c8cc57b31db8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: 79139e42-0238-4e80-8a53-b00cb59e03f0] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:37.930209 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell0:SELECT=6 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:37.944341 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3b576514-f4b5-42d8-b7a4-c8cc57b31db8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:37.947197 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3b576514-f4b5-42d8-b7a4-c8cc57b31db8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:37.948464 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3b576514-f4b5-42d8-b7a4-c8cc57b31db8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:37.949965 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3b576514-f4b5-42d8-b7a4-c8cc57b31db8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:37.951207 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3b576514-f4b5-42d8-b7a4-c8cc57b31db8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:37.952098 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3b576514-f4b5-42d8-b7a4-c8cc57b31db8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:38.540323 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-3b576514-f4b5-42d8-b7a4-c8cc57b31db8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:38.550224 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-3b576514-f4b5-42d8-b7a4-c8cc57b31db8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0" status: 200 len: 1362 microversion: 2.1 time: 0.636797 Oct 19 00:46:38.552851 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 447/877] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:37 2022] GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0 => generated 1362 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:39.578142 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-c22a9004-11b1-4c4c-a38b-64e14dca1eeb tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:39.580285 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-c22a9004-11b1-4c4c-a38b-64e14dca1eeb tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: 79139e42-0238-4e80-8a53-b00cb59e03f0] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:39.584287 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell0:SELECT=2 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:39.585319 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell0:SELECT=6 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:39.597515 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c22a9004-11b1-4c4c-a38b-64e14dca1eeb tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:39.598159 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c22a9004-11b1-4c4c-a38b-64e14dca1eeb tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:39.598681 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c22a9004-11b1-4c4c-a38b-64e14dca1eeb tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:39.599721 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c22a9004-11b1-4c4c-a38b-64e14dca1eeb tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:39.600416 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c22a9004-11b1-4c4c-a38b-64e14dca1eeb tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:39.600937 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c22a9004-11b1-4c4c-a38b-64e14dca1eeb tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:39.630723 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:39.863244 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-c22a9004-11b1-4c4c-a38b-64e14dca1eeb tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:39.871845 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-c22a9004-11b1-4c4c-a38b-64e14dca1eeb tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0" status: 200 len: 1547 microversion: 2.1 time: 0.301315 Oct 19 00:46:39.892884 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 431/878] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:39 2022] GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0 => generated 1547 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:39.903610 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-02464acc-cded-47f9-ba4d-2608e50a945e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:39.904793 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-02464acc-cded-47f9-ba4d-2608e50a945e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: 79139e42-0238-4e80-8a53-b00cb59e03f0] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:39.912175 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-02464acc-cded-47f9-ba4d-2608e50a945e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:39.913094 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-02464acc-cded-47f9-ba4d-2608e50a945e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:39.913765 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-02464acc-cded-47f9-ba4d-2608e50a945e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:39.914703 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-02464acc-cded-47f9-ba4d-2608e50a945e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:39.915890 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-02464acc-cded-47f9-ba4d-2608e50a945e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:39.916517 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-02464acc-cded-47f9-ba4d-2608e50a945e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:40.030309 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-02464acc-cded-47f9-ba4d-2608e50a945e tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.134480 Oct 19 00:46:40.031467 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 448/879] 10.222.0.33 () {58 vars in 1275 bytes} [Wed Oct 19 00:46:39 2022] GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0/os-interface => generated 284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:41.121144 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-b60c929b-23f4-4d4f-80a3-316992dd7abe req-520c6a76-6a31-4db1-a0f6-579aad01a161 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79139e42-0238-4e80-8a53-b00cb59e03f0", "tag": "04cb5aa4-0534-4cce-9ce2-bdd3bc7a0f42"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:41.134342 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-b60c929b-23f4-4d4f-80a3-316992dd7abe req-520c6a76-6a31-4db1-a0f6-579aad01a161 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:41.134829 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-b60c929b-23f4-4d4f-80a3-316992dd7abe req-520c6a76-6a31-4db1-a0f6-579aad01a161 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:41.135689 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-b60c929b-23f4-4d4f-80a3-316992dd7abe req-520c6a76-6a31-4db1-a0f6-579aad01a161 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:41.150671 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-b60c929b-23f4-4d4f-80a3-316992dd7abe req-520c6a76-6a31-4db1-a0f6-579aad01a161 service nova] Creating event network-changed:04cb5aa4-0534-4cce-9ce2-bdd3bc7a0f42 for instance 79139e42-0238-4e80-8a53-b00cb59e03f0 on hv-cinder-maste Oct 19 00:46:41.156763 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-b60c929b-23f4-4d4f-80a3-316992dd7abe req-520c6a76-6a31-4db1-a0f6-579aad01a161 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043407 Oct 19 00:46:41.157926 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 432/880] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:47.455846 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-853accb4-a98c-4e63-a565-3f35998ce12a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:47.456427 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-853accb4-a98c-4e63-a565-3f35998ce12a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: bf3b9e96-22bd-44d1-9871-6a454de72bbe] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:47.462846 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-853accb4-a98c-4e63-a565-3f35998ce12a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:47.463590 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-853accb4-a98c-4e63-a565-3f35998ce12a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:47.464058 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-853accb4-a98c-4e63-a565-3f35998ce12a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:47.464747 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-853accb4-a98c-4e63-a565-3f35998ce12a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:47.465197 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-853accb4-a98c-4e63-a565-3f35998ce12a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:47.465616 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-853accb4-a98c-4e63-a565-3f35998ce12a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:47.488927 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-853accb4-a98c-4e63-a565-3f35998ce12a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe/ips" status: 200 len: 149 microversion: 2.1 time: 0.038294 Oct 19 00:46:47.489472 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 449/881] 10.222.0.33 () {58 vars in 1248 bytes} [Wed Oct 19 00:46:47 2022] GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:48.829056 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-b359b5c5-f637-4879-b401-e419e12cd15a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f06d9cde-b16a-4f8b-a03d-aa7ad7b807ec"}} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:48.831505 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-b359b5c5-f637-4879-b401-e419e12cd15a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: bf3b9e96-22bd-44d1-9871-6a454de72bbe] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:48.838903 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b359b5c5-f637-4879-b401-e419e12cd15a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:48.839390 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b359b5c5-f637-4879-b401-e419e12cd15a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:48.839826 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b359b5c5-f637-4879-b401-e419e12cd15a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:48.840542 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b359b5c5-f637-4879-b401-e419e12cd15a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:48.840991 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b359b5c5-f637-4879-b401-e419e12cd15a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:48.841409 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b359b5c5-f637-4879-b401-e419e12cd15a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:49.117848 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-b359b5c5-f637-4879-b401-e419e12cd15a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "POST /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293020 Oct 19 00:46:49.118458 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 433/882] 10.222.0.33 () {60 vars in 1323 bytes} [Wed Oct 19 00:46:48 2022] POST /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:51.375061 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-a3684c56-66f1-48b8-8379-9c15775ad05f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f06d9cde-b16a-4f8b-a03d-aa7ad7b807ec"}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:51.377509 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-a3684c56-66f1-48b8-8379-9c15775ad05f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: bf3b9e96-22bd-44d1-9871-6a454de72bbe] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:51.380992 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:51.386344 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a3684c56-66f1-48b8-8379-9c15775ad05f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:51.386858 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a3684c56-66f1-48b8-8379-9c15775ad05f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:51.387389 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a3684c56-66f1-48b8-8379-9c15775ad05f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:51.388110 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a3684c56-66f1-48b8-8379-9c15775ad05f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:51.388560 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a3684c56-66f1-48b8-8379-9c15775ad05f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:51.388978 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a3684c56-66f1-48b8-8379-9c15775ad05f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:51.393517 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=1 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:51.476020 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.wsgi [None req-a3684c56-66f1-48b8-8379-9c15775ad05f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] HTTP exception thrown: Invalid volume: volume f06d9cde-b16a-4f8b-a03d-aa7ad7b807ec is already attached to instances: bf3b9e96-22bd-44d1-9871-6a454de72bbe Oct 19 00:46:51.477723 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-a3684c56-66f1-48b8-8379-9c15775ad05f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Request method failure captured: Oct 19 00:46:51.477723 dv-cinder-master-3-smb devstack@n-api.service[125532]: request: POST /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe/os-volume_attachments HTTP/1.1 Oct 19 00:46:51.477723 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept: application/json Oct 19 00:46:51.477723 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept-Encoding: identity Oct 19 00:46:51.477723 dv-cinder-master-3-smb devstack@n-api.service[125532]: Connection: close Oct 19 00:46:51.477723 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Length: 74 Oct 19 00:46:51.477723 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Type: application/json Oct 19 00:46:51.477723 dv-cinder-master-3-smb devstack@n-api.service[125532]: Host: 10.222.0.33 Oct 19 00:46:51.477723 dv-cinder-master-3-smb devstack@n-api.service[125532]: Openstack-System-Scope: None Oct 19 00:46:51.477723 dv-cinder-master-3-smb devstack@n-api.service[125532]: User-Agent: python-urllib3/1.26.12 Oct 19 00:46:51.477723 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Auth-Token: gAAAAABjT0dZO9Cl1BpR1E_5nrd-9g_6W01GCmRr-bxs2oosEmvGRcrx0Y-G0IKovE-TfQsuTKO_S4_zWYg0zNU477VxKqXUVmnxsIfPQLMl-kk4S2RGLMvzztHdGHZY35kfzLdr41wbpFPN7pnfATDs8WY4-rnm9WtQvzLBNibrb2MPfqFKqcA Oct 19 00:46:51.477723 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Id: None Oct 19 00:46:51.477723 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Name: None Oct 19 00:46:51.477723 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Identity-Status: Confirmed Oct 19 00:46:51.477723 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Is-Admin-Project: True Oct 19 00:46:51.477723 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Id: default Oct 19 00:46:51.477723 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Name: Default Oct 19 00:46:51.477723 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Id: 4081d4f735b04367a67a03b9539f5432 Oct 19 00:46:51.477723 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Name: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:46:51.477723 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Role: member,reader Oct 19 00:46:51.477723 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Roles: member,reader Oct 19 00:46:51.479379 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4081d4f735b04367a67a03b9539f5432"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:46:51.479379 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:46:51.479379 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Id: 4081d4f735b04367a67a03b9539f5432 Oct 19 00:46:51.479379 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:46:51.479379 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User: tempest-AttachVolumeNegativeTest-339799867-project Oct 19 00:46:51.479379 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Id: default Oct 19 00:46:51.479379 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Name: Default Oct 19 00:46:51.479379 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Id: 5f9a55c605f04f478d0a71679d8bf6a1 Oct 19 00:46:51.479379 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Name: tempest-AttachVolumeNegativeTest-339799867-project Oct 19 00:46:51.479379 dv-cinder-master-3-smb devstack@n-api.service[125532]: Oct 19 00:46:51.479379 dv-cinder-master-3-smb devstack@n-api.service[125532]: {"volumeAttachment": {"volumeId": "f06d9cde-b16a-4f8b-a03d-aa7ad7b807ec"}} Oct 19 00:46:51.479379 dv-cinder-master-3-smb devstack@n-api.service[125532]: method: > Oct 19 00:46:51.480988 dv-cinder-master-3-smb devstack@n-api.service[125532]: exception: Invalid volume: volume f06d9cde-b16a-4f8b-a03d-aa7ad7b807ec is already attached to instances: bf3b9e96-22bd-44d1-9871-6a454de72bbe Oct 19 00:46:51.480988 dv-cinder-master-3-smb devstack@n-api.service[125532]: action_args: {'server_id': 'bf3b9e96-22bd-44d1-9871-6a454de72bbe', 'body': {'volumeAttachment': {'volumeId': 'f06d9cde-b16a-4f8b-a03d-aa7ad7b807ec'}}} Oct 19 00:46:51.480988 dv-cinder-master-3-smb devstack@n-api.service[125532]: {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:46:51.480988 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:51.480988 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 19 00:46:51.480988 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 19 00:46:51.480988 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 00:46:51.480988 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 00:46:51.480988 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 19 00:46:51.480988 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 00:46:51.480988 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 19 00:46:51.480988 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 19 00:46:51.480988 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 19 00:46:51.480988 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 19 00:46:51.480988 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f06d9cde-b16a-4f8b-a03d-aa7ad7b807ec is already attached to instances: bf3b9e96-22bd-44d1-9871-6a454de72bbe Oct 19 00:46:51.480988 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:46:51.480988 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:51.480988 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:46:51.480988 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:51.482316 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:51.482316 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:51.482316 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:46:51.482316 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:46:51.482316 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:46:51.482316 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:46:51.482316 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:46:51.482316 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:46:51.482316 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:46:51.482316 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:46:51.482316 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:46:51.482316 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:46:51.482316 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 19 00:46:51.482316 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 19 00:46:51.482316 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f06d9cde-b16a-4f8b-a03d-aa7ad7b807ec is already attached to instances: bf3b9e96-22bd-44d1-9871-6a454de72bbe Oct 19 00:46:51.482316 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:46:51.482316 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:51.482316 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:46:51.482316 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:51.482316 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:51.484020 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:51.484020 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:46:51.484020 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:46:51.484020 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f06d9cde-b16a-4f8b-a03d-aa7ad7b807ec is already attached to instances: bf3b9e96-22bd-44d1-9871-6a454de72bbe Oct 19 00:46:51.484020 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:46:51.484020 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-a3684c56-66f1-48b8-8379-9c15775ad05f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Returning 400 to user: Invalid volume: volume f06d9cde-b16a-4f8b-a03d-aa7ad7b807ec is already attached to instances: bf3b9e96-22bd-44d1-9871-6a454de72bbe {{(pid=125532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:46:51.484020 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-a3684c56-66f1-48b8-8379-9c15775ad05f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "POST /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108353 Oct 19 00:46:51.484020 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 450/883] 10.222.0.33 () {60 vars in 1323 bytes} [Wed Oct 19 00:46:51 2022] POST /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:46:51.547424 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-2bb7c405-c8c2-462d-9cb5-238d0bdfc73f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:51.548049 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-2bb7c405-c8c2-462d-9cb5-238d0bdfc73f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: bf3b9e96-22bd-44d1-9871-6a454de72bbe] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:51.550530 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:51.557655 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2bb7c405-c8c2-462d-9cb5-238d0bdfc73f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:51.558146 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2bb7c405-c8c2-462d-9cb5-238d0bdfc73f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:51.558587 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2bb7c405-c8c2-462d-9cb5-238d0bdfc73f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:51.559290 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2bb7c405-c8c2-462d-9cb5-238d0bdfc73f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:51.559747 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2bb7c405-c8c2-462d-9cb5-238d0bdfc73f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:51.560218 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2bb7c405-c8c2-462d-9cb5-238d0bdfc73f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:51.641483 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.objects.instance [None req-2bb7c405-c8c2-462d-9cb5-238d0bdfc73f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lazy-loading 'services' on Instance uuid bf3b9e96-22bd-44d1-9871-6a454de72bbe {{(pid=125531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:46:51.712064 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-2bb7c405-c8c2-462d-9cb5-238d0bdfc73f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe/os-volume_attachments/f06d9cde-b16a-4f8b-a03d-aa7ad7b807ec" status: 202 len: 0 microversion: 2.1 time: 0.168820 Oct 19 00:46:51.712647 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 434/884] 10.222.0.33 () {58 vars in 1416 bytes} [Wed Oct 19 00:46:51 2022] DELETE /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe/os-volume_attachments/f06d9cde-b16a-4f8b-a03d-aa7ad7b807ec => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:46:51.721267 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-aca504e6-05b4-46af-922a-825a108ca5f1 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:51.724042 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-aca504e6-05b4-46af-922a-825a108ca5f1 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: bf3b9e96-22bd-44d1-9871-6a454de72bbe] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:51.731692 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-aca504e6-05b4-46af-922a-825a108ca5f1 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:51.732471 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-aca504e6-05b4-46af-922a-825a108ca5f1 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:51.733145 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-aca504e6-05b4-46af-922a-825a108ca5f1 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:51.734100 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-aca504e6-05b4-46af-922a-825a108ca5f1 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:51.734821 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-aca504e6-05b4-46af-922a-825a108ca5f1 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:51.735255 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-aca504e6-05b4-46af-922a-825a108ca5f1 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:51.768574 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-aca504e6-05b4-46af-922a-825a108ca5f1 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051392 Oct 19 00:46:51.769336 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 451/885] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Oct 19 00:46:51 2022] GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:52.782130 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-78b688a9-3c83-4d18-bcdd-b460edec4bfc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:52.784512 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-78b688a9-3c83-4d18-bcdd-b460edec4bfc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: bf3b9e96-22bd-44d1-9871-6a454de72bbe] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:52.791418 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-78b688a9-3c83-4d18-bcdd-b460edec4bfc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:52.791935 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-78b688a9-3c83-4d18-bcdd-b460edec4bfc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:52.792553 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-78b688a9-3c83-4d18-bcdd-b460edec4bfc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:52.793252 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-78b688a9-3c83-4d18-bcdd-b460edec4bfc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:52.793707 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-78b688a9-3c83-4d18-bcdd-b460edec4bfc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:52.794130 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-78b688a9-3c83-4d18-bcdd-b460edec4bfc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:52.825613 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-78b688a9-3c83-4d18-bcdd-b460edec4bfc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047829 Oct 19 00:46:52.826173 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 435/886] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Oct 19 00:46:52 2022] GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:53.839069 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-a0e82c71-600b-4661-95f1-7ab5cd0527dc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:53.841229 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-a0e82c71-600b-4661-95f1-7ab5cd0527dc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: bf3b9e96-22bd-44d1-9871-6a454de72bbe] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:53.847506 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a0e82c71-600b-4661-95f1-7ab5cd0527dc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:53.848101 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a0e82c71-600b-4661-95f1-7ab5cd0527dc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:53.848788 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a0e82c71-600b-4661-95f1-7ab5cd0527dc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:53.849475 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a0e82c71-600b-4661-95f1-7ab5cd0527dc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:53.849930 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a0e82c71-600b-4661-95f1-7ab5cd0527dc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:53.850376 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a0e82c71-600b-4661-95f1-7ab5cd0527dc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:53.878492 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-a0e82c71-600b-4661-95f1-7ab5cd0527dc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043328 Oct 19 00:46:53.878961 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 452/887] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Oct 19 00:46:53 2022] GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:46:53.942062 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-bf88308e-ffaf-4e21-8a31-d27bf660433b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:53.942722 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-bf88308e-ffaf-4e21-8a31-d27bf660433b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: bf3b9e96-22bd-44d1-9871-6a454de72bbe] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:53.948898 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bf88308e-ffaf-4e21-8a31-d27bf660433b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:53.949377 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bf88308e-ffaf-4e21-8a31-d27bf660433b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:53.949811 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bf88308e-ffaf-4e21-8a31-d27bf660433b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:53.950503 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bf88308e-ffaf-4e21-8a31-d27bf660433b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:53.950951 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bf88308e-ffaf-4e21-8a31-d27bf660433b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:53.951372 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-bf88308e-ffaf-4e21-8a31-d27bf660433b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:53.976825 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-bf88308e-ffaf-4e21-8a31-d27bf660433b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: bf3b9e96-22bd-44d1-9871-6a454de72bbe] Going to try to terminate instance {{(pid=125531) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:46:54.051363 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-bf88308e-ffaf-4e21-8a31-d27bf660433b tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe" status: 204 len: 0 microversion: 2.1 time: 0.113266 Oct 19 00:46:54.051895 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 436/888] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Oct 19 00:46:53 2022] DELETE /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:46:54.060168 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-aa84d4b6-a48e-4e03-83ba-db10e34a8a28 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:54.060786 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-aa84d4b6-a48e-4e03-83ba-db10e34a8a28 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: bf3b9e96-22bd-44d1-9871-6a454de72bbe] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:54.067423 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-aa84d4b6-a48e-4e03-83ba-db10e34a8a28 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:54.067950 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-aa84d4b6-a48e-4e03-83ba-db10e34a8a28 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:54.068392 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-aa84d4b6-a48e-4e03-83ba-db10e34a8a28 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:54.069093 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-aa84d4b6-a48e-4e03-83ba-db10e34a8a28 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:54.069557 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-aa84d4b6-a48e-4e03-83ba-db10e34a8a28 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:54.069987 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-aa84d4b6-a48e-4e03-83ba-db10e34a8a28 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:54.197791 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-aa84d4b6-a48e-4e03-83ba-db10e34a8a28 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:54.205490 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-aa84d4b6-a48e-4e03-83ba-db10e34a8a28 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe" status: 200 len: 1681 microversion: 2.1 time: 0.149412 Oct 19 00:46:54.206055 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 453/889] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:54 2022] GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:55.230363 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-b0655be1-7416-4089-a514-945bc5531b45 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:55.231073 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-b0655be1-7416-4089-a514-945bc5531b45 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: bf3b9e96-22bd-44d1-9871-6a454de72bbe] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:55.237658 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b0655be1-7416-4089-a514-945bc5531b45 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:55.238212 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b0655be1-7416-4089-a514-945bc5531b45 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:55.239200 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b0655be1-7416-4089-a514-945bc5531b45 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:55.240050 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b0655be1-7416-4089-a514-945bc5531b45 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:55.240509 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b0655be1-7416-4089-a514-945bc5531b45 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:55.240938 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b0655be1-7416-4089-a514-945bc5531b45 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:55.370264 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-b0655be1-7416-4089-a514-945bc5531b45 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:55.377957 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-b0655be1-7416-4089-a514-945bc5531b45 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe" status: 200 len: 1681 microversion: 2.1 time: 0.151896 Oct 19 00:46:55.378516 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 437/890] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:55 2022] GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:56.402254 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-b627f209-1acf-4e63-b860-e9c74fe872d8 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:56.402868 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-b627f209-1acf-4e63-b860-e9c74fe872d8 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: bf3b9e96-22bd-44d1-9871-6a454de72bbe] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:56.409421 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b627f209-1acf-4e63-b860-e9c74fe872d8 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:56.409903 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b627f209-1acf-4e63-b860-e9c74fe872d8 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:56.410339 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b627f209-1acf-4e63-b860-e9c74fe872d8 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:56.411033 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b627f209-1acf-4e63-b860-e9c74fe872d8 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:56.411486 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b627f209-1acf-4e63-b860-e9c74fe872d8 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:56.411994 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b627f209-1acf-4e63-b860-e9c74fe872d8 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:56.568523 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-b627f209-1acf-4e63-b860-e9c74fe872d8 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:56.577375 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-b627f209-1acf-4e63-b860-e9c74fe872d8 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe" status: 200 len: 1681 microversion: 2.1 time: 0.179095 Oct 19 00:46:56.577942 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 454/891] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:56 2022] GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:57.355977 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-f12942c5-d8fa-4904-829a-328bbf1d9444 req-8bb90aab-ccdd-42df-844c-738392a7507c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf3b9e96-22bd-44d1-9871-6a454de72bbe", "name": "network-vif-deleted", "tag": "503b0fd3-4b77-41f7-8483-4834ad6947f7"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:57.369291 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-f12942c5-d8fa-4904-829a-328bbf1d9444 req-8bb90aab-ccdd-42df-844c-738392a7507c service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:57.369765 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-f12942c5-d8fa-4904-829a-328bbf1d9444 req-8bb90aab-ccdd-42df-844c-738392a7507c service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:57.370961 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-f12942c5-d8fa-4904-829a-328bbf1d9444 req-8bb90aab-ccdd-42df-844c-738392a7507c service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:57.387533 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-f12942c5-d8fa-4904-829a-328bbf1d9444 req-8bb90aab-ccdd-42df-844c-738392a7507c service nova] Creating event network-vif-deleted:503b0fd3-4b77-41f7-8483-4834ad6947f7 for instance bf3b9e96-22bd-44d1-9871-6a454de72bbe on hv-cinder-maste Oct 19 00:46:57.392948 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-f12942c5-d8fa-4904-829a-328bbf1d9444 req-8bb90aab-ccdd-42df-844c-738392a7507c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044031 Oct 19 00:46:57.393533 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 438/892] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:57.600381 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-3b54f97d-507b-4488-b0b7-07582a920548 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:57.600998 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-3b54f97d-507b-4488-b0b7-07582a920548 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: bf3b9e96-22bd-44d1-9871-6a454de72bbe] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:57.607794 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3b54f97d-507b-4488-b0b7-07582a920548 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:57.608527 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3b54f97d-507b-4488-b0b7-07582a920548 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:57.609274 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3b54f97d-507b-4488-b0b7-07582a920548 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:57.610147 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3b54f97d-507b-4488-b0b7-07582a920548 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:57.610773 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3b54f97d-507b-4488-b0b7-07582a920548 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:57.611353 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3b54f97d-507b-4488-b0b7-07582a920548 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:57.646053 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3b54f97d-507b-4488-b0b7-07582a920548 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:57.647422 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3b54f97d-507b-4488-b0b7-07582a920548 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:57.647948 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3b54f97d-507b-4488-b0b7-07582a920548 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:57.648339 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.objects.instance [None req-3b54f97d-507b-4488-b0b7-07582a920548 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lazy-loading 'fault' on Instance uuid bf3b9e96-22bd-44d1-9871-6a454de72bbe {{(pid=125532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:46:57.694707 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-3b54f97d-507b-4488-b0b7-07582a920548 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:57.702580 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-3b54f97d-507b-4488-b0b7-07582a920548 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe" status: 200 len: 1332 microversion: 2.1 time: 0.106301 Oct 19 00:46:57.703322 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 455/893] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:57 2022] GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe => generated 1332 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:58.727549 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-111348d1-d61b-4080-849b-125e7fc6ffdc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:58.728296 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-111348d1-d61b-4080-849b-125e7fc6ffdc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: bf3b9e96-22bd-44d1-9871-6a454de72bbe] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:58.735447 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-111348d1-d61b-4080-849b-125e7fc6ffdc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:58.735968 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-111348d1-d61b-4080-849b-125e7fc6ffdc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:58.736478 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-111348d1-d61b-4080-849b-125e7fc6ffdc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:58.737582 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-111348d1-d61b-4080-849b-125e7fc6ffdc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:58.738049 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-111348d1-d61b-4080-849b-125e7fc6ffdc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:58.738472 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-111348d1-d61b-4080-849b-125e7fc6ffdc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:58.752323 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.wsgi [None req-111348d1-d61b-4080-849b-125e7fc6ffdc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] HTTP exception thrown: Instance bf3b9e96-22bd-44d1-9871-6a454de72bbe could not be found. Oct 19 00:46:58.753965 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-111348d1-d61b-4080-849b-125e7fc6ffdc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Request method failure captured: Oct 19 00:46:58.753965 dv-cinder-master-3-smb devstack@n-api.service[125531]: request: GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe HTTP/1.1 Oct 19 00:46:58.753965 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept: application/json Oct 19 00:46:58.753965 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept-Encoding: identity Oct 19 00:46:58.753965 dv-cinder-master-3-smb devstack@n-api.service[125531]: Connection: close Oct 19 00:46:58.753965 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Length: 0 Oct 19 00:46:58.753965 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Type: application/json Oct 19 00:46:58.753965 dv-cinder-master-3-smb devstack@n-api.service[125531]: Host: 10.222.0.33 Oct 19 00:46:58.753965 dv-cinder-master-3-smb devstack@n-api.service[125531]: Openstack-System-Scope: None Oct 19 00:46:58.753965 dv-cinder-master-3-smb devstack@n-api.service[125531]: User-Agent: python-urllib3/1.26.12 Oct 19 00:46:58.753965 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Auth-Token: gAAAAABjT0dZO9Cl1BpR1E_5nrd-9g_6W01GCmRr-bxs2oosEmvGRcrx0Y-G0IKovE-TfQsuTKO_S4_zWYg0zNU477VxKqXUVmnxsIfPQLMl-kk4S2RGLMvzztHdGHZY35kfzLdr41wbpFPN7pnfATDs8WY4-rnm9WtQvzLBNibrb2MPfqFKqcA Oct 19 00:46:58.753965 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Id: None Oct 19 00:46:58.753965 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Name: None Oct 19 00:46:58.753965 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Identity-Status: Confirmed Oct 19 00:46:58.753965 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Is-Admin-Project: True Oct 19 00:46:58.753965 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Id: default Oct 19 00:46:58.753965 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Name: Default Oct 19 00:46:58.753965 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Id: 4081d4f735b04367a67a03b9539f5432 Oct 19 00:46:58.753965 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Name: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:46:58.753965 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Role: member,reader Oct 19 00:46:58.753965 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Roles: member,reader Oct 19 00:46:58.755449 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4081d4f735b04367a67a03b9539f5432"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:46:58.755449 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:46:58.755449 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Id: 4081d4f735b04367a67a03b9539f5432 Oct 19 00:46:58.755449 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:46:58.755449 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User: tempest-AttachVolumeNegativeTest-339799867-project Oct 19 00:46:58.755449 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Id: default Oct 19 00:46:58.755449 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Name: Default Oct 19 00:46:58.755449 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Id: 5f9a55c605f04f478d0a71679d8bf6a1 Oct 19 00:46:58.755449 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Name: tempest-AttachVolumeNegativeTest-339799867-project Oct 19 00:46:58.755449 dv-cinder-master-3-smb devstack@n-api.service[125531]: method: > Oct 19 00:46:58.755449 dv-cinder-master-3-smb devstack@n-api.service[125531]: exception: Instance bf3b9e96-22bd-44d1-9871-6a454de72bbe could not be found. Oct 19 00:46:58.755449 dv-cinder-master-3-smb devstack@n-api.service[125531]: action_args: {'id': 'bf3b9e96-22bd-44d1-9871-6a454de72bbe'} Oct 19 00:46:58.756827 dv-cinder-master-3-smb devstack@n-api.service[125531]: {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:46:58.756827 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:58.756827 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:46:58.756827 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:46:58.756827 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:46:58.756827 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:46:58.756827 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:46:58.756827 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:46:58.756827 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:46:58.756827 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:46:58.756827 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf3b9e96-22bd-44d1-9871-6a454de72bbe could not be found. Oct 19 00:46:58.756827 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:46:58.756827 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:58.756827 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:46:58.756827 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:58.756827 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:58.756827 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:58.756827 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:46:58.756827 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:46:58.756827 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:46:58.758318 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:46:58.758318 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:46:58.758318 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:46:58.758318 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:46:58.758318 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:46:58.758318 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:46:58.758318 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:46:58.758318 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf3b9e96-22bd-44d1-9871-6a454de72bbe could not be found. Oct 19 00:46:58.758318 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:46:58.758318 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:58.758318 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:46:58.758318 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:58.758318 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:58.758318 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:58.758318 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:46:58.758318 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:46:58.758318 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf3b9e96-22bd-44d1-9871-6a454de72bbe could not be found. Oct 19 00:46:58.758318 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:46:58.759612 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-111348d1-d61b-4080-849b-125e7fc6ffdc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Returning 404 to user: Instance bf3b9e96-22bd-44d1-9871-6a454de72bbe could not be found. {{(pid=125531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:46:58.759612 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-111348d1-d61b-4080-849b-125e7fc6ffdc tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe" status: 404 len: 111 microversion: 2.1 time: 0.033007 Oct 19 00:46:58.759612 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 439/894] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:58 2022] GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:46:58.765388 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-3a82cf7d-1115-4423-924b-9a038230376f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '.version_select at 0x7f81f0e8cf70>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:58.786594 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-3a82cf7d-1115-4423-924b-9a038230376f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1772851410" status: 202 len: 0 microversion: 2.1 time: 0.024981 Oct 19 00:46:58.788462 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 456/895] 10.222.0.33 () {58 vars in 1221 bytes} [Wed Oct 19 00:46:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1772851410 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:46:59.656722 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-9d7c96e9-4e6c-4235-87d4-a4e9328deb77 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Action: 'create', calling method: .version_select at 0x7f81f1294ee0>, body: {"keypair": {"name": "tempest-keypair-1520945711", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB33G91o1CnRvzUz/hPjlTO78zGJIsdc7b5E9HQSjOcdiY6v+oKbgDa1eeTshpTPjEQR/TNxzSIJq0x3Jl6j4Yg73FaYJVTfpU5hk7KBe5+aRLlZqHeZ+8tuHUkNRHrXUA=="}} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:59.671733 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.quota [None req-9d7c96e9-4e6c-4235-87d4-a4e9328deb77 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Getting quotas for project 4081d4f735b04367a67a03b9539f5432. Resources: {'key_pairs'} {{(pid=125531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:46:59.675500 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.quota [None req-9d7c96e9-4e6c-4235-87d4-a4e9328deb77 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Getting quotas for user 5f9a55c605f04f478d0a71679d8bf6a1 and project 4081d4f735b04367a67a03b9539f5432. Resources: {'key_pairs'} {{(pid=125531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:46:59.697636 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-9d7c96e9-4e6c-4235-87d4-a4e9328deb77 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044827 Oct 19 00:46:59.698216 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 440/896] 10.222.0.33 () {60 vars in 1159 bytes} [Wed Oct 19 00:46:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:47:01.026313 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-553fb21e-4f43-4c68-b7ea-6421c828cc58 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-762176121", "imageRef": "d1f4abc9-3bb9-4343-9a05-53d758070c9d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e4e49b3c-1347-4eda-9be1-f1139c6e3c46"}], "security_groups": [{"name": "tempest-securitygroup--86104596"}], "key_name": "tempest-keypair-1520945711", "user_data": "}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:47:01.140899 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.network.neutron [None req-553fb21e-4f43-4c68-b7ea-6421c828cc58 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] validate_networks() for [('e4e49b3c-1347-4eda-9be1-f1139c6e3c46', None, None, None, None, None)] {{(pid=125532) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:47:01.530208 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-553fb21e-4f43-4c68-b7ea-6421c828cc58 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Flavor limits 0:0:0 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:47:01.530632 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-553fb21e-4f43-4c68-b7ea-6421c828cc58 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Image limits 0:0:0 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:47:01.531106 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-553fb21e-4f43-4c68-b7ea-6421c828cc58 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Flavor pref 0:0:0 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:47:01.531517 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-553fb21e-4f43-4c68-b7ea-6421c828cc58 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Image pref 0:0:0 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:47:01.531956 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.virt.hardware [None req-553fb21e-4f43-4c68-b7ea-6421c828cc58 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125532) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:47:01.542404 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-553fb21e-4f43-4c68-b7ea-6421c828cc58 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:01.542889 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-553fb21e-4f43-4c68-b7ea-6421c828cc58 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:01.543498 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-553fb21e-4f43-4c68-b7ea-6421c828cc58 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:01.544314 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-553fb21e-4f43-4c68-b7ea-6421c828cc58 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:01.544771 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-553fb21e-4f43-4c68-b7ea-6421c828cc58 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:01.545346 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-553fb21e-4f43-4c68-b7ea-6421c828cc58 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:01.565983 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.quota [None req-553fb21e-4f43-4c68-b7ea-6421c828cc58 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Getting quotas for project 4081d4f735b04367a67a03b9539f5432. Resources: {'instances', 'cores', 'ram'} {{(pid=125532) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:47:01.570290 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.quota [None req-553fb21e-4f43-4c68-b7ea-6421c828cc58 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Getting quotas for user 5f9a55c605f04f478d0a71679d8bf6a1 and project 4081d4f735b04367a67a03b9539f5432. Resources: {'instances', 'cores', 'ram'} {{(pid=125532) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:47:01.581534 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-553fb21e-4f43-4c68-b7ea-6421c828cc58 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Going to run 1 instances... {{(pid=125532) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:47:01.584053 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-553fb21e-4f43-4c68-b7ea-6421c828cc58 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: a47e01df-7873-48e6-9df8-6bcf54a0f468] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1f4abc9-3bb9-4343-9a05-53d758070c9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125532) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:47:01.637564 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-553fb21e-4f43-4c68-b7ea-6421c828cc58 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.616882 Oct 19 00:47:01.645273 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 457/897] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Oct 19 00:47:01 2022] POST /compute/v2.1/servers => generated 400 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:47:01.651485 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-01f6999e-efc8-4e0d-a4c3-c637d70b8d0a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:01.652120 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-01f6999e-efc8-4e0d-a4c3-c637d70b8d0a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: a47e01df-7873-48e6-9df8-6bcf54a0f468] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:01.713790 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-01f6999e-efc8-4e0d-a4c3-c637d70b8d0a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:01.722387 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-01f6999e-efc8-4e0d-a4c3-c637d70b8d0a tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468" status: 200 len: 1241 microversion: 2.1 time: 0.075835 Oct 19 00:47:01.739755 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 441/898] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:01 2022] GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468 => generated 1241 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:02.747917 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-0642a2de-38cc-468d-9ab1-9c9745cac89d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:02.749460 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-0642a2de-38cc-468d-9ab1-9c9745cac89d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: a47e01df-7873-48e6-9df8-6bcf54a0f468] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:02.759529 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0642a2de-38cc-468d-9ab1-9c9745cac89d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:02.760129 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0642a2de-38cc-468d-9ab1-9c9745cac89d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:02.760656 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0642a2de-38cc-468d-9ab1-9c9745cac89d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:02.761433 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0642a2de-38cc-468d-9ab1-9c9745cac89d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:02.761958 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0642a2de-38cc-468d-9ab1-9c9745cac89d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:02.762452 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0642a2de-38cc-468d-9ab1-9c9745cac89d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:02.845013 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-0642a2de-38cc-468d-9ab1-9c9745cac89d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:02.856053 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-0642a2de-38cc-468d-9ab1-9c9745cac89d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468" status: 200 len: 1293 microversion: 2.1 time: 0.112310 Oct 19 00:47:02.856654 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 458/899] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:02 2022] GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468 => generated 1293 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:03.883022 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-97e22a5b-d25f-4fbd-ae83-fa1b16fe0a0e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:03.884434 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-97e22a5b-d25f-4fbd-ae83-fa1b16fe0a0e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: a47e01df-7873-48e6-9df8-6bcf54a0f468] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:03.891190 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-97e22a5b-d25f-4fbd-ae83-fa1b16fe0a0e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:03.891972 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-97e22a5b-d25f-4fbd-ae83-fa1b16fe0a0e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:03.892667 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-97e22a5b-d25f-4fbd-ae83-fa1b16fe0a0e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:03.893774 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-97e22a5b-d25f-4fbd-ae83-fa1b16fe0a0e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:03.894448 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-97e22a5b-d25f-4fbd-ae83-fa1b16fe0a0e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:03.895306 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-97e22a5b-d25f-4fbd-ae83-fa1b16fe0a0e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:04.041485 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-97e22a5b-d25f-4fbd-ae83-fa1b16fe0a0e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:04.049659 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-97e22a5b-d25f-4fbd-ae83-fa1b16fe0a0e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468" status: 200 len: 1365 microversion: 2.1 time: 0.172211 Oct 19 00:47:04.050341 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 442/900] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:03 2022] GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:04.488556 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-9d84cb26-dc5f-4eaa-93a8-88bffa18efba req-99bc8796-6ef1-4f07-ac4b-47786ded607b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a47e01df-7873-48e6-9df8-6bcf54a0f468", "tag": "6bbea366-c3a9-4be5-9b0a-2327f4e99ff1"}]} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:47:04.501978 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-9d84cb26-dc5f-4eaa-93a8-88bffa18efba req-99bc8796-6ef1-4f07-ac4b-47786ded607b service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:04.502449 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-9d84cb26-dc5f-4eaa-93a8-88bffa18efba req-99bc8796-6ef1-4f07-ac4b-47786ded607b service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:04.503107 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-9d84cb26-dc5f-4eaa-93a8-88bffa18efba req-99bc8796-6ef1-4f07-ac4b-47786ded607b service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:04.518361 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.compute.server_external_events [req-9d84cb26-dc5f-4eaa-93a8-88bffa18efba req-99bc8796-6ef1-4f07-ac4b-47786ded607b service nova] Creating event network-changed:6bbea366-c3a9-4be5-9b0a-2327f4e99ff1 for instance a47e01df-7873-48e6-9df8-6bcf54a0f468 on hv-cinder-maste Oct 19 00:47:04.525034 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-9d84cb26-dc5f-4eaa-93a8-88bffa18efba req-99bc8796-6ef1-4f07-ac4b-47786ded607b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040825 Oct 19 00:47:04.525631 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 459/901] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:47:05.078584 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-566cea32-83b0-450c-84b7-9a0a83d65cb9 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:05.079199 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-566cea32-83b0-450c-84b7-9a0a83d65cb9 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: a47e01df-7873-48e6-9df8-6bcf54a0f468] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:05.086449 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-566cea32-83b0-450c-84b7-9a0a83d65cb9 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:05.086928 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-566cea32-83b0-450c-84b7-9a0a83d65cb9 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:05.087364 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-566cea32-83b0-450c-84b7-9a0a83d65cb9 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:05.088092 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-566cea32-83b0-450c-84b7-9a0a83d65cb9 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:05.088548 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-566cea32-83b0-450c-84b7-9a0a83d65cb9 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:05.088975 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-566cea32-83b0-450c-84b7-9a0a83d65cb9 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:05.221894 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-566cea32-83b0-450c-84b7-9a0a83d65cb9 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:05.229991 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-566cea32-83b0-450c-84b7-9a0a83d65cb9 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468" status: 200 len: 1365 microversion: 2.1 time: 0.155396 Oct 19 00:47:05.230550 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 443/902] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:05 2022] GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:06.254106 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-004478a4-dbae-428d-8871-629baad4fc1d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:06.254807 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-004478a4-dbae-428d-8871-629baad4fc1d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: a47e01df-7873-48e6-9df8-6bcf54a0f468] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:06.261462 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-004478a4-dbae-428d-8871-629baad4fc1d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:06.261929 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-004478a4-dbae-428d-8871-629baad4fc1d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:06.262380 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-004478a4-dbae-428d-8871-629baad4fc1d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:06.263056 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-004478a4-dbae-428d-8871-629baad4fc1d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:06.263502 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-004478a4-dbae-428d-8871-629baad4fc1d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:06.263946 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-004478a4-dbae-428d-8871-629baad4fc1d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:06.394407 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-004478a4-dbae-428d-8871-629baad4fc1d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:06.402661 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-004478a4-dbae-428d-8871-629baad4fc1d tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468" status: 200 len: 1365 microversion: 2.1 time: 0.152949 Oct 19 00:47:06.403242 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 460/903] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:06 2022] GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:07.425043 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-8ae4ded0-9ae5-4e09-951c-ce2992522846 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:07.425713 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-8ae4ded0-9ae5-4e09-951c-ce2992522846 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: a47e01df-7873-48e6-9df8-6bcf54a0f468] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:07.433190 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8ae4ded0-9ae5-4e09-951c-ce2992522846 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:07.433695 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8ae4ded0-9ae5-4e09-951c-ce2992522846 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:07.434254 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8ae4ded0-9ae5-4e09-951c-ce2992522846 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:07.434813 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8ae4ded0-9ae5-4e09-951c-ce2992522846 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:07.435262 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8ae4ded0-9ae5-4e09-951c-ce2992522846 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:07.435683 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-8ae4ded0-9ae5-4e09-951c-ce2992522846 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:07.572259 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-8ae4ded0-9ae5-4e09-951c-ce2992522846 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:07.580092 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-8ae4ded0-9ae5-4e09-951c-ce2992522846 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468" status: 200 len: 1365 microversion: 2.1 time: 0.158888 Oct 19 00:47:07.580647 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 444/904] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:07 2022] GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:08.602533 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-d848fead-5beb-4b10-8621-95243af196d2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:08.603152 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-d848fead-5beb-4b10-8621-95243af196d2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: a47e01df-7873-48e6-9df8-6bcf54a0f468] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:08.613837 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d848fead-5beb-4b10-8621-95243af196d2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:08.613837 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d848fead-5beb-4b10-8621-95243af196d2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:08.613837 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d848fead-5beb-4b10-8621-95243af196d2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:08.613837 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d848fead-5beb-4b10-8621-95243af196d2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:08.614167 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d848fead-5beb-4b10-8621-95243af196d2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:08.614167 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d848fead-5beb-4b10-8621-95243af196d2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:08.751426 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-d848fead-5beb-4b10-8621-95243af196d2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:08.759076 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-d848fead-5beb-4b10-8621-95243af196d2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468" status: 200 len: 1365 microversion: 2.1 time: 0.160584 Oct 19 00:47:08.759633 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 461/905] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:08 2022] GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:09.782671 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-02ebe3df-5d0d-4642-897e-f0b640e9e3d3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:09.783206 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-02ebe3df-5d0d-4642-897e-f0b640e9e3d3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: a47e01df-7873-48e6-9df8-6bcf54a0f468] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:09.790320 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-02ebe3df-5d0d-4642-897e-f0b640e9e3d3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:09.790811 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-02ebe3df-5d0d-4642-897e-f0b640e9e3d3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:09.791249 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-02ebe3df-5d0d-4642-897e-f0b640e9e3d3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:09.791995 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-02ebe3df-5d0d-4642-897e-f0b640e9e3d3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:09.792452 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-02ebe3df-5d0d-4642-897e-f0b640e9e3d3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:09.792877 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-02ebe3df-5d0d-4642-897e-f0b640e9e3d3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:09.796967 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:09.935928 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-02ebe3df-5d0d-4642-897e-f0b640e9e3d3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:09.944702 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-02ebe3df-5d0d-4642-897e-f0b640e9e3d3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468" status: 200 len: 1365 microversion: 2.1 time: 0.166077 Oct 19 00:47:09.945265 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 445/906] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:09 2022] GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:10.093589 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-c6a6cb8c-2a0f-4661-8452-80508e37f902 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:10.094778 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-c6a6cb8c-2a0f-4661-8452-80508e37f902 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:10.107481 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c6a6cb8c-2a0f-4661-8452-80508e37f902 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:10.109492 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c6a6cb8c-2a0f-4661-8452-80508e37f902 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:10.110126 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c6a6cb8c-2a0f-4661-8452-80508e37f902 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:10.111026 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c6a6cb8c-2a0f-4661-8452-80508e37f902 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:10.111626 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c6a6cb8c-2a0f-4661-8452-80508e37f902 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:10.112230 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c6a6cb8c-2a0f-4661-8452-80508e37f902 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:10.137847 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-c6a6cb8c-2a0f-4661-8452-80508e37f902 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4/ips" status: 200 len: 150 microversion: 2.20 time: 0.048058 Oct 19 00:47:10.138447 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 462/907] 10.222.0.33 () {60 vars in 1289 bytes} [Wed Oct 19 00:47:10 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4/ips => generated 150 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:47:10.969822 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-a82d03b2-70a6-4b54-b887-24cf425903ad tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:10.970526 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-a82d03b2-70a6-4b54-b887-24cf425903ad tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: a47e01df-7873-48e6-9df8-6bcf54a0f468] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:10.979774 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a82d03b2-70a6-4b54-b887-24cf425903ad tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:10.980368 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a82d03b2-70a6-4b54-b887-24cf425903ad tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:10.980846 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a82d03b2-70a6-4b54-b887-24cf425903ad tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:10.981568 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a82d03b2-70a6-4b54-b887-24cf425903ad tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:10.982039 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a82d03b2-70a6-4b54-b887-24cf425903ad tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:10.982468 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a82d03b2-70a6-4b54-b887-24cf425903ad tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:11.146771 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-a82d03b2-70a6-4b54-b887-24cf425903ad tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:11.156181 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-a82d03b2-70a6-4b54-b887-24cf425903ad tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468" status: 200 len: 1365 microversion: 2.1 time: 0.191170 Oct 19 00:47:11.156925 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 446/908] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:10 2022] GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468 => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:11.625718 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-190f6196-151c-4dd1-979e-f24ef6faf644 req-fbe91e89-567b-4391-8bb5-e08180328d22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a47e01df-7873-48e6-9df8-6bcf54a0f468", "name": "network-vif-plugged", "status": "completed", "tag": "6bbea366-c3a9-4be5-9b0a-2327f4e99ff1"}]} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:47:11.636224 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell0:SELECT=2 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:11.637565 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell0:SELECT=6 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:11.639816 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-190f6196-151c-4dd1-979e-f24ef6faf644 req-fbe91e89-567b-4391-8bb5-e08180328d22 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:11.640521 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-190f6196-151c-4dd1-979e-f24ef6faf644 req-fbe91e89-567b-4391-8bb5-e08180328d22 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:11.641194 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-190f6196-151c-4dd1-979e-f24ef6faf644 req-fbe91e89-567b-4391-8bb5-e08180328d22 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:11.654071 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.compute.server_external_events [req-190f6196-151c-4dd1-979e-f24ef6faf644 req-fbe91e89-567b-4391-8bb5-e08180328d22 service nova] Creating event network-vif-plugged:6bbea366-c3a9-4be5-9b0a-2327f4e99ff1 for instance a47e01df-7873-48e6-9df8-6bcf54a0f468 on hv-cinder-maste Oct 19 00:47:11.659138 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-190f6196-151c-4dd1-979e-f24ef6faf644 req-fbe91e89-567b-4391-8bb5-e08180328d22 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037084 Oct 19 00:47:11.659968 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 463/909] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:47:12.071087 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-68216e80-cbe0-4b30-8442-d327b9cda429 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:47:12.071646 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-68216e80-cbe0-4b30-8442-d327b9cda429 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:12.073517 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell0:SELECT=6 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:12.079167 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-68216e80-cbe0-4b30-8442-d327b9cda429 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:12.079641 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-68216e80-cbe0-4b30-8442-d327b9cda429 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:12.080099 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-68216e80-cbe0-4b30-8442-d327b9cda429 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:12.080793 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-68216e80-cbe0-4b30-8442-d327b9cda429 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:12.081244 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-68216e80-cbe0-4b30-8442-d327b9cda429 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:12.081665 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-68216e80-cbe0-4b30-8442-d327b9cda429 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:12.105051 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.objects.instance [None req-68216e80-cbe0-4b30-8442-d327b9cda429 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lazy-loading 'flavor' on Instance uuid 7a48c163-1acb-4ff4-8f2e-b6b529707da4 {{(pid=125531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:47:12.181160 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-377db188-89c2-4ee1-8236-9865c0c57bdf tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:12.181872 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-377db188-89c2-4ee1-8236-9865c0c57bdf tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: a47e01df-7873-48e6-9df8-6bcf54a0f468] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:12.188093 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-377db188-89c2-4ee1-8236-9865c0c57bdf tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:12.188573 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-377db188-89c2-4ee1-8236-9865c0c57bdf tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:12.189010 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-377db188-89c2-4ee1-8236-9865c0c57bdf tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:12.189703 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-377db188-89c2-4ee1-8236-9865c0c57bdf tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:12.190159 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-377db188-89c2-4ee1-8236-9865c0c57bdf tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:12.190587 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-377db188-89c2-4ee1-8236-9865c0c57bdf tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:12.294262 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-68216e80-cbe0-4b30-8442-d327b9cda429 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "POST /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4/action" status: 202 len: 0 microversion: 2.20 time: 0.227542 Oct 19 00:47:12.294851 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 447/910] 10.222.0.33 () {62 vars in 1319 bytes} [Wed Oct 19 00:47:12 2022] POST /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:47:12.303698 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-37d601ee-4b12-4f28-926a-f3a3e67ad960 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:12.304512 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-37d601ee-4b12-4f28-926a-f3a3e67ad960 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:12.310795 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-37d601ee-4b12-4f28-926a-f3a3e67ad960 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:12.311347 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-37d601ee-4b12-4f28-926a-f3a3e67ad960 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:12.311846 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-37d601ee-4b12-4f28-926a-f3a3e67ad960 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:12.312631 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-37d601ee-4b12-4f28-926a-f3a3e67ad960 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:12.313181 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-37d601ee-4b12-4f28-926a-f3a3e67ad960 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:12.313599 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-37d601ee-4b12-4f28-926a-f3a3e67ad960 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:12.327662 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-377db188-89c2-4ee1-8236-9865c0c57bdf tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:12.335908 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-377db188-89c2-4ee1-8236-9865c0c57bdf tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468" status: 200 len: 1365 microversion: 2.1 time: 0.158747 Oct 19 00:47:12.336477 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 464/911] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:12 2022] GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:47:12.451751 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-37d601ee-4b12-4f28-926a-f3a3e67ad960 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:12.462231 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-37d601ee-4b12-4f28-926a-f3a3e67ad960 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:12.463752 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-37d601ee-4b12-4f28-926a-f3a3e67ad960 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:12.465000 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-37d601ee-4b12-4f28-926a-f3a3e67ad960 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1722 microversion: 2.20 time: 0.165948 Oct 19 00:47:12.465561 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 448/912] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:12 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:47:13.362224 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-26f27318-9b9a-4d29-9eca-7269a48c676c tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:13.362749 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-26f27318-9b9a-4d29-9eca-7269a48c676c tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: a47e01df-7873-48e6-9df8-6bcf54a0f468] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:13.369358 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-26f27318-9b9a-4d29-9eca-7269a48c676c tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:13.369837 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-26f27318-9b9a-4d29-9eca-7269a48c676c tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:13.370269 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-26f27318-9b9a-4d29-9eca-7269a48c676c tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:13.370959 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-26f27318-9b9a-4d29-9eca-7269a48c676c tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:13.371426 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-26f27318-9b9a-4d29-9eca-7269a48c676c tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:13.371830 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-26f27318-9b9a-4d29-9eca-7269a48c676c tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:13.490551 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-652c051f-dc3d-4241-9e71-25f11bc19c11 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:13.491157 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-652c051f-dc3d-4241-9e71-25f11bc19c11 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:13.497794 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-652c051f-dc3d-4241-9e71-25f11bc19c11 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:13.498273 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-652c051f-dc3d-4241-9e71-25f11bc19c11 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:13.498702 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-652c051f-dc3d-4241-9e71-25f11bc19c11 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:13.499357 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-26f27318-9b9a-4d29-9eca-7269a48c676c tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:13.499521 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-652c051f-dc3d-4241-9e71-25f11bc19c11 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:13.499825 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-652c051f-dc3d-4241-9e71-25f11bc19c11 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:13.500403 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-652c051f-dc3d-4241-9e71-25f11bc19c11 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:13.507795 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-26f27318-9b9a-4d29-9eca-7269a48c676c tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468" status: 200 len: 1365 microversion: 2.1 time: 0.149522 Oct 19 00:47:13.508397 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 465/913] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:13 2022] GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:47:13.639727 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-652c051f-dc3d-4241-9e71-25f11bc19c11 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:13.650487 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-652c051f-dc3d-4241-9e71-25f11bc19c11 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:13.652012 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-652c051f-dc3d-4241-9e71-25f11bc19c11 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:13.653387 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-652c051f-dc3d-4241-9e71-25f11bc19c11 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1722 microversion: 2.20 time: 0.166638 Oct 19 00:47:13.654261 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 449/914] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:13 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:14.536063 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-11aca1a3-2c6d-46cf-ae6b-f47d1ab5dbd9 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:14.536063 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-11aca1a3-2c6d-46cf-ae6b-f47d1ab5dbd9 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: a47e01df-7873-48e6-9df8-6bcf54a0f468] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:14.537777 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-11aca1a3-2c6d-46cf-ae6b-f47d1ab5dbd9 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:14.539520 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-11aca1a3-2c6d-46cf-ae6b-f47d1ab5dbd9 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:14.540008 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-11aca1a3-2c6d-46cf-ae6b-f47d1ab5dbd9 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:14.540783 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-11aca1a3-2c6d-46cf-ae6b-f47d1ab5dbd9 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:14.541262 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-11aca1a3-2c6d-46cf-ae6b-f47d1ab5dbd9 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:14.541736 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-11aca1a3-2c6d-46cf-ae6b-f47d1ab5dbd9 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:14.678818 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-308b7493-74ac-4be2-82e5-f9376fcea6f4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:14.680058 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-308b7493-74ac-4be2-82e5-f9376fcea6f4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:14.686329 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-308b7493-74ac-4be2-82e5-f9376fcea6f4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:14.686820 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-308b7493-74ac-4be2-82e5-f9376fcea6f4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:14.687252 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-308b7493-74ac-4be2-82e5-f9376fcea6f4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:14.687977 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-308b7493-74ac-4be2-82e5-f9376fcea6f4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:14.688432 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-308b7493-74ac-4be2-82e5-f9376fcea6f4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:14.688851 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-308b7493-74ac-4be2-82e5-f9376fcea6f4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:14.823486 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-308b7493-74ac-4be2-82e5-f9376fcea6f4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:14.831894 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-308b7493-74ac-4be2-82e5-f9376fcea6f4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:14.833488 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-308b7493-74ac-4be2-82e5-f9376fcea6f4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:14.834667 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-308b7493-74ac-4be2-82e5-f9376fcea6f4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1722 microversion: 2.20 time: 0.159903 Oct 19 00:47:14.835940 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-11aca1a3-2c6d-46cf-ae6b-f47d1ab5dbd9 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:14.836074 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 450/915] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:14 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:47:14.843821 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-11aca1a3-2c6d-46cf-ae6b-f47d1ab5dbd9 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468" status: 200 len: 1554 microversion: 2.1 time: 0.317085 Oct 19 00:47:14.844390 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 466/916] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:14 2022] GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468 => generated 1554 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:47:14.865652 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-e2c4f2fe-a4cd-44cc-b197-52b006e30578 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:14.866177 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-e2c4f2fe-a4cd-44cc-b197-52b006e30578 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: a47e01df-7873-48e6-9df8-6bcf54a0f468] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:14.873288 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e2c4f2fe-a4cd-44cc-b197-52b006e30578 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:14.873771 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e2c4f2fe-a4cd-44cc-b197-52b006e30578 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:14.874276 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e2c4f2fe-a4cd-44cc-b197-52b006e30578 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:14.874883 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e2c4f2fe-a4cd-44cc-b197-52b006e30578 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:14.875331 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e2c4f2fe-a4cd-44cc-b197-52b006e30578 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:14.875751 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e2c4f2fe-a4cd-44cc-b197-52b006e30578 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:14.952635 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-e2c4f2fe-a4cd-44cc-b197-52b006e30578 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090762 Oct 19 00:47:14.953220 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 451/917] 10.222.0.33 () {58 vars in 1275 bytes} [Wed Oct 19 00:47:14 2022] GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:47:15.861841 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-e2012ffc-6be4-4056-993e-7b0ff8832a79 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:15.862624 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-e2012ffc-6be4-4056-993e-7b0ff8832a79 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:15.877638 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e2012ffc-6be4-4056-993e-7b0ff8832a79 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:15.878246 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e2012ffc-6be4-4056-993e-7b0ff8832a79 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:15.878793 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e2012ffc-6be4-4056-993e-7b0ff8832a79 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:15.880177 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e2012ffc-6be4-4056-993e-7b0ff8832a79 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:15.880749 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e2012ffc-6be4-4056-993e-7b0ff8832a79 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:15.881964 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e2012ffc-6be4-4056-993e-7b0ff8832a79 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:16.023192 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-e2012ffc-6be4-4056-993e-7b0ff8832a79 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:16.032411 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-e2012ffc-6be4-4056-993e-7b0ff8832a79 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:16.034319 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-e2012ffc-6be4-4056-993e-7b0ff8832a79 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:16.035667 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-e2012ffc-6be4-4056-993e-7b0ff8832a79 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1722 microversion: 2.20 time: 0.177846 Oct 19 00:47:16.036316 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 467/918] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:15 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:16.181190 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-ad5e820a-0e8c-465a-aa71-75c2faed7b0e req-c5ee0a4d-f22a-466a-a654-7e40ec6055e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a47e01df-7873-48e6-9df8-6bcf54a0f468", "tag": "6bbea366-c3a9-4be5-9b0a-2327f4e99ff1"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:47:16.191058 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-ad5e820a-0e8c-465a-aa71-75c2faed7b0e req-c5ee0a4d-f22a-466a-a654-7e40ec6055e3 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:16.191566 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-ad5e820a-0e8c-465a-aa71-75c2faed7b0e req-c5ee0a4d-f22a-466a-a654-7e40ec6055e3 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:16.192005 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-ad5e820a-0e8c-465a-aa71-75c2faed7b0e req-c5ee0a4d-f22a-466a-a654-7e40ec6055e3 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:16.205700 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-ad5e820a-0e8c-465a-aa71-75c2faed7b0e req-c5ee0a4d-f22a-466a-a654-7e40ec6055e3 service nova] Creating event network-changed:6bbea366-c3a9-4be5-9b0a-2327f4e99ff1 for instance a47e01df-7873-48e6-9df8-6bcf54a0f468 on hv-cinder-maste Oct 19 00:47:16.211618 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-ad5e820a-0e8c-465a-aa71-75c2faed7b0e req-c5ee0a4d-f22a-466a-a654-7e40ec6055e3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044203 Oct 19 00:47:16.212430 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 452/919] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:47:17.063550 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-6e8040de-d658-4ebf-b432-e71bef47140d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:17.065502 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-6e8040de-d658-4ebf-b432-e71bef47140d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:17.074013 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6e8040de-d658-4ebf-b432-e71bef47140d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:17.074718 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6e8040de-d658-4ebf-b432-e71bef47140d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:17.075344 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6e8040de-d658-4ebf-b432-e71bef47140d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:17.076285 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6e8040de-d658-4ebf-b432-e71bef47140d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:17.076740 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6e8040de-d658-4ebf-b432-e71bef47140d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:17.077334 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6e8040de-d658-4ebf-b432-e71bef47140d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:17.221878 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-6e8040de-d658-4ebf-b432-e71bef47140d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:17.230056 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-6e8040de-d658-4ebf-b432-e71bef47140d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:17.231504 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-6e8040de-d658-4ebf-b432-e71bef47140d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:17.232723 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-6e8040de-d658-4ebf-b432-e71bef47140d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1722 microversion: 2.20 time: 0.174500 Oct 19 00:47:17.236217 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 468/920] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:17 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:18.258597 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-7d27f98f-3d5b-4987-ac0c-99269fc263ed tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:18.259295 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-7d27f98f-3d5b-4987-ac0c-99269fc263ed tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:18.265590 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7d27f98f-3d5b-4987-ac0c-99269fc263ed tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:18.266075 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7d27f98f-3d5b-4987-ac0c-99269fc263ed tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:18.266514 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7d27f98f-3d5b-4987-ac0c-99269fc263ed tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:18.267209 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7d27f98f-3d5b-4987-ac0c-99269fc263ed tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:18.267781 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7d27f98f-3d5b-4987-ac0c-99269fc263ed tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:18.268284 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7d27f98f-3d5b-4987-ac0c-99269fc263ed tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:18.401867 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-7d27f98f-3d5b-4987-ac0c-99269fc263ed tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:18.411597 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-7d27f98f-3d5b-4987-ac0c-99269fc263ed tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:18.413774 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-7d27f98f-3d5b-4987-ac0c-99269fc263ed tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:18.415006 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-7d27f98f-3d5b-4987-ac0c-99269fc263ed tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1722 microversion: 2.20 time: 0.161283 Oct 19 00:47:18.415562 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 453/921] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:18 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:19.439972 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-a06a56ac-3e53-456f-b2d0-de1c6858ad43 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:19.440578 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-a06a56ac-3e53-456f-b2d0-de1c6858ad43 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:19.447040 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a06a56ac-3e53-456f-b2d0-de1c6858ad43 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:19.447564 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a06a56ac-3e53-456f-b2d0-de1c6858ad43 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:19.448033 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a06a56ac-3e53-456f-b2d0-de1c6858ad43 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:19.448710 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a06a56ac-3e53-456f-b2d0-de1c6858ad43 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:19.449164 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a06a56ac-3e53-456f-b2d0-de1c6858ad43 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:19.449618 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a06a56ac-3e53-456f-b2d0-de1c6858ad43 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:19.583790 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-a06a56ac-3e53-456f-b2d0-de1c6858ad43 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:19.586886 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell1:SELECT=100 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:19.594290 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-a06a56ac-3e53-456f-b2d0-de1c6858ad43 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:19.595719 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-a06a56ac-3e53-456f-b2d0-de1c6858ad43 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:19.597183 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-a06a56ac-3e53-456f-b2d0-de1c6858ad43 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1722 microversion: 2.20 time: 0.161232 Oct 19 00:47:19.597727 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 469/922] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:19 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:20.624712 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-c8f096e8-1942-40a5-924f-01943b3b088e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:20.625315 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-c8f096e8-1942-40a5-924f-01943b3b088e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:20.631715 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c8f096e8-1942-40a5-924f-01943b3b088e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:20.632851 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c8f096e8-1942-40a5-924f-01943b3b088e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:20.633348 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c8f096e8-1942-40a5-924f-01943b3b088e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:20.634089 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c8f096e8-1942-40a5-924f-01943b3b088e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:20.634628 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c8f096e8-1942-40a5-924f-01943b3b088e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:20.635093 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c8f096e8-1942-40a5-924f-01943b3b088e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:20.769165 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-c8f096e8-1942-40a5-924f-01943b3b088e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:20.778327 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-c8f096e8-1942-40a5-924f-01943b3b088e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:20.779777 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-c8f096e8-1942-40a5-924f-01943b3b088e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:20.780966 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-c8f096e8-1942-40a5-924f-01943b3b088e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1722 microversion: 2.20 time: 0.160309 Oct 19 00:47:20.781511 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 454/923] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:20 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:21.806604 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-cf96f7d3-5993-46f9-b5ff-a1cd8283609c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:21.807431 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-cf96f7d3-5993-46f9-b5ff-a1cd8283609c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:21.810357 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:21.815965 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cf96f7d3-5993-46f9-b5ff-a1cd8283609c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:21.816614 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cf96f7d3-5993-46f9-b5ff-a1cd8283609c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:21.817058 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cf96f7d3-5993-46f9-b5ff-a1cd8283609c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:21.817801 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cf96f7d3-5993-46f9-b5ff-a1cd8283609c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:21.818262 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cf96f7d3-5993-46f9-b5ff-a1cd8283609c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:21.818692 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-cf96f7d3-5993-46f9-b5ff-a1cd8283609c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:21.954023 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-cf96f7d3-5993-46f9-b5ff-a1cd8283609c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:21.963280 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-cf96f7d3-5993-46f9-b5ff-a1cd8283609c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:21.964847 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-cf96f7d3-5993-46f9-b5ff-a1cd8283609c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:21.966074 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-cf96f7d3-5993-46f9-b5ff-a1cd8283609c tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1722 microversion: 2.20 time: 0.163402 Oct 19 00:47:21.966494 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 470/924] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:21 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:22.992391 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-faf42262-3b79-49ee-91e6-30bcc1d665ff tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:22.993265 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-faf42262-3b79-49ee-91e6-30bcc1d665ff tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:22.995833 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:23.001254 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-faf42262-3b79-49ee-91e6-30bcc1d665ff tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:23.001734 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-faf42262-3b79-49ee-91e6-30bcc1d665ff tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:23.002167 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-faf42262-3b79-49ee-91e6-30bcc1d665ff tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:23.002875 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-faf42262-3b79-49ee-91e6-30bcc1d665ff tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:23.003323 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-faf42262-3b79-49ee-91e6-30bcc1d665ff tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:23.003743 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-faf42262-3b79-49ee-91e6-30bcc1d665ff tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:23.139023 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-faf42262-3b79-49ee-91e6-30bcc1d665ff tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:23.147043 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-faf42262-3b79-49ee-91e6-30bcc1d665ff tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:23.148881 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-faf42262-3b79-49ee-91e6-30bcc1d665ff tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:23.150058 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-faf42262-3b79-49ee-91e6-30bcc1d665ff tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1722 microversion: 2.20 time: 0.161896 Oct 19 00:47:23.150613 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 455/925] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:22 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:24.176084 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-9ff1b081-6ff7-4c47-aff4-cbc7841d514d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:24.176623 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-9ff1b081-6ff7-4c47-aff4-cbc7841d514d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:24.183148 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9ff1b081-6ff7-4c47-aff4-cbc7841d514d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:24.183627 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9ff1b081-6ff7-4c47-aff4-cbc7841d514d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:24.184093 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9ff1b081-6ff7-4c47-aff4-cbc7841d514d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:24.184785 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9ff1b081-6ff7-4c47-aff4-cbc7841d514d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:24.185236 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9ff1b081-6ff7-4c47-aff4-cbc7841d514d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:24.185658 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9ff1b081-6ff7-4c47-aff4-cbc7841d514d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:24.314800 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-9ff1b081-6ff7-4c47-aff4-cbc7841d514d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:24.324380 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-9ff1b081-6ff7-4c47-aff4-cbc7841d514d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:24.325828 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-9ff1b081-6ff7-4c47-aff4-cbc7841d514d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:24.326996 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-9ff1b081-6ff7-4c47-aff4-cbc7841d514d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1743 microversion: 2.20 time: 0.155218 Oct 19 00:47:24.327552 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 471/926] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:24 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:25.353735 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-70de1957-1620-43d6-83e4-3160992ff818 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:25.354447 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-70de1957-1620-43d6-83e4-3160992ff818 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:25.362175 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-70de1957-1620-43d6-83e4-3160992ff818 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:25.362660 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-70de1957-1620-43d6-83e4-3160992ff818 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:25.363093 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-70de1957-1620-43d6-83e4-3160992ff818 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:25.363787 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-70de1957-1620-43d6-83e4-3160992ff818 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:25.364305 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-70de1957-1620-43d6-83e4-3160992ff818 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:25.364728 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-70de1957-1620-43d6-83e4-3160992ff818 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:25.493172 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-70de1957-1620-43d6-83e4-3160992ff818 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:25.501146 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-70de1957-1620-43d6-83e4-3160992ff818 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:25.502585 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-70de1957-1620-43d6-83e4-3160992ff818 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:25.503740 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-70de1957-1620-43d6-83e4-3160992ff818 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1743 microversion: 2.20 time: 0.155040 Oct 19 00:47:25.504316 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 456/927] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:25 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:26.528953 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-e8415b3b-6213-4a51-bba7-db569179dea5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:26.529565 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-e8415b3b-6213-4a51-bba7-db569179dea5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:26.536016 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e8415b3b-6213-4a51-bba7-db569179dea5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:26.536498 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e8415b3b-6213-4a51-bba7-db569179dea5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:26.536935 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e8415b3b-6213-4a51-bba7-db569179dea5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:26.537632 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e8415b3b-6213-4a51-bba7-db569179dea5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:26.538130 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e8415b3b-6213-4a51-bba7-db569179dea5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:26.538574 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e8415b3b-6213-4a51-bba7-db569179dea5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:26.903497 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-e8415b3b-6213-4a51-bba7-db569179dea5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:26.911492 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-e8415b3b-6213-4a51-bba7-db569179dea5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:26.913493 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-e8415b3b-6213-4a51-bba7-db569179dea5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:26.914651 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-e8415b3b-6213-4a51-bba7-db569179dea5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1743 microversion: 2.20 time: 0.389609 Oct 19 00:47:26.915210 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 472/928] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:26 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1743 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:27.708613 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-e3360721-96af-4334-a0c0-a62a8e3d60fa req-c0706a72-4d64-4052-b95a-9cec92f8f89e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a48c163-1acb-4ff4-8f2e-b6b529707da4", "name": "network-vif-plugged", "status": "completed", "tag": "3fc16ed1-ad15-4f2c-8cb0-7877e83842ab"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:47:27.722860 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-e3360721-96af-4334-a0c0-a62a8e3d60fa req-c0706a72-4d64-4052-b95a-9cec92f8f89e service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:27.723377 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-e3360721-96af-4334-a0c0-a62a8e3d60fa req-c0706a72-4d64-4052-b95a-9cec92f8f89e service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:27.723819 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-e3360721-96af-4334-a0c0-a62a8e3d60fa req-c0706a72-4d64-4052-b95a-9cec92f8f89e service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:27.736860 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-e3360721-96af-4334-a0c0-a62a8e3d60fa req-c0706a72-4d64-4052-b95a-9cec92f8f89e service nova] Creating event network-vif-plugged:3fc16ed1-ad15-4f2c-8cb0-7877e83842ab for instance 7a48c163-1acb-4ff4-8f2e-b6b529707da4 on hv-cinder-maste Oct 19 00:47:27.742795 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-e3360721-96af-4334-a0c0-a62a8e3d60fa req-c0706a72-4d64-4052-b95a-9cec92f8f89e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037413 Oct 19 00:47:27.743658 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 457/929] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:47:27.939555 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-19bc686e-3135-47ca-91bb-a9b1db95c399 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:27.940127 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-19bc686e-3135-47ca-91bb-a9b1db95c399 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:27.947107 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-19bc686e-3135-47ca-91bb-a9b1db95c399 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:27.947585 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-19bc686e-3135-47ca-91bb-a9b1db95c399 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:27.948123 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-19bc686e-3135-47ca-91bb-a9b1db95c399 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:27.948816 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-19bc686e-3135-47ca-91bb-a9b1db95c399 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:27.949269 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-19bc686e-3135-47ca-91bb-a9b1db95c399 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:27.949689 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-19bc686e-3135-47ca-91bb-a9b1db95c399 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:28.082820 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-19bc686e-3135-47ca-91bb-a9b1db95c399 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:28.091006 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-19bc686e-3135-47ca-91bb-a9b1db95c399 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:28.092475 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-19bc686e-3135-47ca-91bb-a9b1db95c399 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:28.093629 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-19bc686e-3135-47ca-91bb-a9b1db95c399 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1743 microversion: 2.20 time: 0.158070 Oct 19 00:47:28.094182 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 473/930] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:27 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:29.119531 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-000fd6f2-ba83-4400-9d5f-b9a3bcdada5d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:29.120245 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-000fd6f2-ba83-4400-9d5f-b9a3bcdada5d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:29.126806 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-000fd6f2-ba83-4400-9d5f-b9a3bcdada5d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:29.127309 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-000fd6f2-ba83-4400-9d5f-b9a3bcdada5d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:29.127740 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-000fd6f2-ba83-4400-9d5f-b9a3bcdada5d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:29.128440 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-000fd6f2-ba83-4400-9d5f-b9a3bcdada5d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:29.128890 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-000fd6f2-ba83-4400-9d5f-b9a3bcdada5d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:29.129308 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-000fd6f2-ba83-4400-9d5f-b9a3bcdada5d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:29.261029 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-000fd6f2-ba83-4400-9d5f-b9a3bcdada5d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:29.270127 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-000fd6f2-ba83-4400-9d5f-b9a3bcdada5d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:29.271555 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-000fd6f2-ba83-4400-9d5f-b9a3bcdada5d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:29.273333 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-000fd6f2-ba83-4400-9d5f-b9a3bcdada5d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1743 microversion: 2.20 time: 0.158398 Oct 19 00:47:29.273887 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 458/931] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:29 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:30.298567 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-90ba5ac3-0460-484d-a6cb-b6c09e01d3d4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:30.299173 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-90ba5ac3-0460-484d-a6cb-b6c09e01d3d4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:30.306170 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-90ba5ac3-0460-484d-a6cb-b6c09e01d3d4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:30.306650 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-90ba5ac3-0460-484d-a6cb-b6c09e01d3d4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:30.307086 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-90ba5ac3-0460-484d-a6cb-b6c09e01d3d4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:30.307774 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-90ba5ac3-0460-484d-a6cb-b6c09e01d3d4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:30.308257 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-90ba5ac3-0460-484d-a6cb-b6c09e01d3d4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:30.308679 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-90ba5ac3-0460-484d-a6cb-b6c09e01d3d4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:30.440628 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-90ba5ac3-0460-484d-a6cb-b6c09e01d3d4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:30.449828 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-90ba5ac3-0460-484d-a6cb-b6c09e01d3d4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:30.451252 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-90ba5ac3-0460-484d-a6cb-b6c09e01d3d4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:30.452446 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-90ba5ac3-0460-484d-a6cb-b6c09e01d3d4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1743 microversion: 2.20 time: 0.157838 Oct 19 00:47:30.452990 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 474/932] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:30 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:31.478194 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-4eb7c228-4d11-4641-a2f2-14e9dfaa91b5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:31.480340 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-4eb7c228-4d11-4641-a2f2-14e9dfaa91b5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:31.487519 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4eb7c228-4d11-4641-a2f2-14e9dfaa91b5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:31.488183 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4eb7c228-4d11-4641-a2f2-14e9dfaa91b5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:31.488712 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4eb7c228-4d11-4641-a2f2-14e9dfaa91b5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:31.489444 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4eb7c228-4d11-4641-a2f2-14e9dfaa91b5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:31.489903 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4eb7c228-4d11-4641-a2f2-14e9dfaa91b5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:31.490333 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4eb7c228-4d11-4641-a2f2-14e9dfaa91b5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:31.646713 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-4eb7c228-4d11-4641-a2f2-14e9dfaa91b5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:31.657431 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-4eb7c228-4d11-4641-a2f2-14e9dfaa91b5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:31.659245 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-4eb7c228-4d11-4641-a2f2-14e9dfaa91b5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:31.660863 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-4eb7c228-4d11-4641-a2f2-14e9dfaa91b5 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1738 microversion: 2.20 time: 0.187309 Oct 19 00:47:31.668844 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 459/933] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:31 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:32.686915 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-10e963c3-15f9-4f1a-975a-75be88ecc57b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:32.687834 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-10e963c3-15f9-4f1a-975a-75be88ecc57b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:32.695801 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-10e963c3-15f9-4f1a-975a-75be88ecc57b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:32.696559 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-10e963c3-15f9-4f1a-975a-75be88ecc57b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:32.697153 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-10e963c3-15f9-4f1a-975a-75be88ecc57b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:32.698138 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-10e963c3-15f9-4f1a-975a-75be88ecc57b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:32.698741 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-10e963c3-15f9-4f1a-975a-75be88ecc57b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:32.699318 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-10e963c3-15f9-4f1a-975a-75be88ecc57b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:32.847245 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-10e963c3-15f9-4f1a-975a-75be88ecc57b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:32.855997 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-10e963c3-15f9-4f1a-975a-75be88ecc57b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:32.857673 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-10e963c3-15f9-4f1a-975a-75be88ecc57b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:32.859050 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-10e963c3-15f9-4f1a-975a-75be88ecc57b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1738 microversion: 2.20 time: 0.176185 Oct 19 00:47:32.859760 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 475/934] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:32 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:33.888039 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-98ee6611-489e-40f5-bba5-cc4f4f4e0e2e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:33.888588 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-98ee6611-489e-40f5-bba5-cc4f4f4e0e2e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:33.895343 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-98ee6611-489e-40f5-bba5-cc4f4f4e0e2e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:33.895829 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-98ee6611-489e-40f5-bba5-cc4f4f4e0e2e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:33.896338 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-98ee6611-489e-40f5-bba5-cc4f4f4e0e2e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:33.897299 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-98ee6611-489e-40f5-bba5-cc4f4f4e0e2e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:33.898837 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-98ee6611-489e-40f5-bba5-cc4f4f4e0e2e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:33.899622 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-98ee6611-489e-40f5-bba5-cc4f4f4e0e2e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:34.063736 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-98ee6611-489e-40f5-bba5-cc4f4f4e0e2e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:34.073149 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-98ee6611-489e-40f5-bba5-cc4f4f4e0e2e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:34.074841 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-98ee6611-489e-40f5-bba5-cc4f4f4e0e2e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:34.076248 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-98ee6611-489e-40f5-bba5-cc4f4f4e0e2e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1738 microversion: 2.20 time: 0.193179 Oct 19 00:47:34.077348 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 460/935] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:33 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1738 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:35.102717 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-faaf80cc-fa54-4ab3-ac30-3f0e5fdada82 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:35.104084 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-faaf80cc-fa54-4ab3-ac30-3f0e5fdada82 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:35.110689 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-faaf80cc-fa54-4ab3-ac30-3f0e5fdada82 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:35.111250 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-faaf80cc-fa54-4ab3-ac30-3f0e5fdada82 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:35.111759 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-faaf80cc-fa54-4ab3-ac30-3f0e5fdada82 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:35.112587 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-faaf80cc-fa54-4ab3-ac30-3f0e5fdada82 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:35.113265 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-faaf80cc-fa54-4ab3-ac30-3f0e5fdada82 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:35.114147 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-faaf80cc-fa54-4ab3-ac30-3f0e5fdada82 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:35.270567 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-faaf80cc-fa54-4ab3-ac30-3f0e5fdada82 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:35.281424 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-faaf80cc-fa54-4ab3-ac30-3f0e5fdada82 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:35.283242 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-faaf80cc-fa54-4ab3-ac30-3f0e5fdada82 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:35.284661 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-faaf80cc-fa54-4ab3-ac30-3f0e5fdada82 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1738 microversion: 2.20 time: 0.186702 Oct 19 00:47:35.285537 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 476/936] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:35 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:36.312932 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-65185526-5083-4908-808b-235463ee0908 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:36.313547 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-65185526-5083-4908-808b-235463ee0908 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:36.320679 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-65185526-5083-4908-808b-235463ee0908 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:36.321154 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-65185526-5083-4908-808b-235463ee0908 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:36.321581 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-65185526-5083-4908-808b-235463ee0908 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:36.322266 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-65185526-5083-4908-808b-235463ee0908 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:36.322713 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-65185526-5083-4908-808b-235463ee0908 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:36.323130 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-65185526-5083-4908-808b-235463ee0908 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:36.344934 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:36.476043 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-65185526-5083-4908-808b-235463ee0908 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:36.487532 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-65185526-5083-4908-808b-235463ee0908 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:36.489547 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-65185526-5083-4908-808b-235463ee0908 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:36.490739 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-65185526-5083-4908-808b-235463ee0908 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1738 microversion: 2.20 time: 0.181698 Oct 19 00:47:36.492290 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 461/937] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:36 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:47:37.518156 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-709d9d19-ae25-4482-8df7-57cf47adc9c3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:37.518156 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-709d9d19-ae25-4482-8df7-57cf47adc9c3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:37.524367 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-709d9d19-ae25-4482-8df7-57cf47adc9c3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:37.524850 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-709d9d19-ae25-4482-8df7-57cf47adc9c3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:37.525576 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-709d9d19-ae25-4482-8df7-57cf47adc9c3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:37.526288 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-709d9d19-ae25-4482-8df7-57cf47adc9c3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:37.527375 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-709d9d19-ae25-4482-8df7-57cf47adc9c3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:37.527375 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-709d9d19-ae25-4482-8df7-57cf47adc9c3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:37.709375 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-709d9d19-ae25-4482-8df7-57cf47adc9c3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:37.719902 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-709d9d19-ae25-4482-8df7-57cf47adc9c3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:37.722125 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-709d9d19-ae25-4482-8df7-57cf47adc9c3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:37.724699 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-709d9d19-ae25-4482-8df7-57cf47adc9c3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1738 microversion: 2.20 time: 0.210398 Oct 19 00:47:37.741261 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 477/938] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:37 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1738 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:38.753342 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-b6706e0b-d309-4f03-a98e-7c6abc6db950 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:38.753954 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-b6706e0b-d309-4f03-a98e-7c6abc6db950 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:38.761469 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b6706e0b-d309-4f03-a98e-7c6abc6db950 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:38.761952 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b6706e0b-d309-4f03-a98e-7c6abc6db950 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:38.763200 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b6706e0b-d309-4f03-a98e-7c6abc6db950 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:38.763941 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b6706e0b-d309-4f03-a98e-7c6abc6db950 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:38.764396 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b6706e0b-d309-4f03-a98e-7c6abc6db950 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:38.764825 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b6706e0b-d309-4f03-a98e-7c6abc6db950 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:38.910347 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-b6706e0b-d309-4f03-a98e-7c6abc6db950 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:38.920414 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-b6706e0b-d309-4f03-a98e-7c6abc6db950 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:38.921858 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-b6706e0b-d309-4f03-a98e-7c6abc6db950 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:38.923204 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-b6706e0b-d309-4f03-a98e-7c6abc6db950 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1738 microversion: 2.20 time: 0.174344 Oct 19 00:47:38.923580 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 462/939] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:38 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:39.949099 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-b41ef662-a5e6-4bff-b074-d029bde346b9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:39.949886 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-b41ef662-a5e6-4bff-b074-d029bde346b9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:39.966074 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b41ef662-a5e6-4bff-b074-d029bde346b9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:39.966615 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b41ef662-a5e6-4bff-b074-d029bde346b9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:39.967058 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b41ef662-a5e6-4bff-b074-d029bde346b9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:39.968448 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b41ef662-a5e6-4bff-b074-d029bde346b9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:39.968914 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b41ef662-a5e6-4bff-b074-d029bde346b9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:39.969347 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b41ef662-a5e6-4bff-b074-d029bde346b9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:40.124385 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-b41ef662-a5e6-4bff-b074-d029bde346b9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:40.134077 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-b41ef662-a5e6-4bff-b074-d029bde346b9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:40.137182 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-b41ef662-a5e6-4bff-b074-d029bde346b9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:40.138979 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-b41ef662-a5e6-4bff-b074-d029bde346b9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1738 microversion: 2.20 time: 0.193647 Oct 19 00:47:40.151874 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 478/940] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:39 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:41.167744 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-682a3da0-ad10-4623-9c50-d722820c27bd tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:41.168940 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-682a3da0-ad10-4623-9c50-d722820c27bd tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:41.176133 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-682a3da0-ad10-4623-9c50-d722820c27bd tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:41.177790 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-682a3da0-ad10-4623-9c50-d722820c27bd tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:41.180765 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-682a3da0-ad10-4623-9c50-d722820c27bd tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:41.182003 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-682a3da0-ad10-4623-9c50-d722820c27bd tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:41.183693 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-682a3da0-ad10-4623-9c50-d722820c27bd tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:41.185184 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-682a3da0-ad10-4623-9c50-d722820c27bd tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:41.330354 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-682a3da0-ad10-4623-9c50-d722820c27bd tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:41.339722 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-682a3da0-ad10-4623-9c50-d722820c27bd tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:41.341336 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-682a3da0-ad10-4623-9c50-d722820c27bd tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:41.342521 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-682a3da0-ad10-4623-9c50-d722820c27bd tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1738 microversion: 2.20 time: 0.180015 Oct 19 00:47:41.347172 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 463/941] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:41 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:42.368628 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-1f910ad7-56f4-4d5f-88b0-760f068a80de tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:42.369238 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-1f910ad7-56f4-4d5f-88b0-760f068a80de tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:42.375594 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1f910ad7-56f4-4d5f-88b0-760f068a80de tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:42.376110 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1f910ad7-56f4-4d5f-88b0-760f068a80de tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:42.376543 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1f910ad7-56f4-4d5f-88b0-760f068a80de tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:42.377261 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1f910ad7-56f4-4d5f-88b0-760f068a80de tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:42.377685 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1f910ad7-56f4-4d5f-88b0-760f068a80de tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:42.378108 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1f910ad7-56f4-4d5f-88b0-760f068a80de tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:42.583724 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-1f910ad7-56f4-4d5f-88b0-760f068a80de tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:42.592872 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-1f910ad7-56f4-4d5f-88b0-760f068a80de tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:42.594297 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-1f910ad7-56f4-4d5f-88b0-760f068a80de tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:42.595475 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-1f910ad7-56f4-4d5f-88b0-760f068a80de tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1720 microversion: 2.20 time: 0.231027 Oct 19 00:47:42.596048 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 479/942] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:42 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1720 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:43.621830 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-dff874c4-acad-49b1-8901-501e0a492241 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:43.622444 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-dff874c4-acad-49b1-8901-501e0a492241 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:43.629358 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dff874c4-acad-49b1-8901-501e0a492241 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:43.629840 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dff874c4-acad-49b1-8901-501e0a492241 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:43.630276 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dff874c4-acad-49b1-8901-501e0a492241 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:43.630964 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dff874c4-acad-49b1-8901-501e0a492241 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:43.631415 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dff874c4-acad-49b1-8901-501e0a492241 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:43.632256 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dff874c4-acad-49b1-8901-501e0a492241 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:43.762154 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-dff874c4-acad-49b1-8901-501e0a492241 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:43.770165 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-dff874c4-acad-49b1-8901-501e0a492241 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:43.771594 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-dff874c4-acad-49b1-8901-501e0a492241 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:43.773305 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-dff874c4-acad-49b1-8901-501e0a492241 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1720 microversion: 2.20 time: 0.155640 Oct 19 00:47:43.773860 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 464/943] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:43 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:44.799294 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-2839fb56-3cb2-491c-808a-af767663ba51 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:44.799919 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-2839fb56-3cb2-491c-808a-af767663ba51 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:44.807756 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2839fb56-3cb2-491c-808a-af767663ba51 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:44.808425 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2839fb56-3cb2-491c-808a-af767663ba51 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:44.808866 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2839fb56-3cb2-491c-808a-af767663ba51 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:44.809557 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2839fb56-3cb2-491c-808a-af767663ba51 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:44.810038 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2839fb56-3cb2-491c-808a-af767663ba51 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:44.810458 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2839fb56-3cb2-491c-808a-af767663ba51 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:44.945928 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-2839fb56-3cb2-491c-808a-af767663ba51 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:44.954210 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-2839fb56-3cb2-491c-808a-af767663ba51 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:44.955684 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-2839fb56-3cb2-491c-808a-af767663ba51 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:44.956962 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-2839fb56-3cb2-491c-808a-af767663ba51 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1723 microversion: 2.20 time: 0.162278 Oct 19 00:47:44.957571 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 480/944] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:44 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:44.982765 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-b27fbf45-79d6-462c-a940-0761bf5ee475 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "16eaec19-7e51-4f0d-941e-4199e578469a"}} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:47:44.985179 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-b27fbf45-79d6-462c-a940-0761bf5ee475 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:44.992914 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b27fbf45-79d6-462c-a940-0761bf5ee475 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:44.993645 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b27fbf45-79d6-462c-a940-0761bf5ee475 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:44.994071 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b27fbf45-79d6-462c-a940-0761bf5ee475 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:44.994764 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b27fbf45-79d6-462c-a940-0761bf5ee475 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:44.995211 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b27fbf45-79d6-462c-a940-0761bf5ee475 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:44.995628 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b27fbf45-79d6-462c-a940-0761bf5ee475 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:45.274705 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-b27fbf45-79d6-462c-a940-0761bf5ee475 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "POST /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.295814 Oct 19 00:47:45.275321 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 465/945] 10.222.0.33 () {62 vars in 1364 bytes} [Wed Oct 19 00:47:44 2022] POST /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4/os-volume_attachments => generated 188 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:47:45.403102 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-945d0e54-bae0-429f-b9d2-8d5ca2d6149d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:45.403599 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-945d0e54-bae0-429f-b9d2-8d5ca2d6149d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:45.409505 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-945d0e54-bae0-429f-b9d2-8d5ca2d6149d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:45.409988 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-945d0e54-bae0-429f-b9d2-8d5ca2d6149d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:45.410475 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-945d0e54-bae0-429f-b9d2-8d5ca2d6149d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:45.411116 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-945d0e54-bae0-429f-b9d2-8d5ca2d6149d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:45.411574 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-945d0e54-bae0-429f-b9d2-8d5ca2d6149d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:45.412040 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-945d0e54-bae0-429f-b9d2-8d5ca2d6149d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:45.652930 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-945d0e54-bae0-429f-b9d2-8d5ca2d6149d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4/os-volume_attachments/16eaec19-7e51-4f0d-941e-4199e578469a" status: 202 len: 0 microversion: 2.20 time: 0.253770 Oct 19 00:47:45.653521 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 481/946] 10.222.0.33 () {60 vars in 1457 bytes} [Wed Oct 19 00:47:45 2022] DELETE /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4/os-volume_attachments/16eaec19-7e51-4f0d-941e-4199e578469a => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:47:45.717012 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-d7eb53cf-36ae-4a41-8f06-9d28881bec45 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:47:45.717697 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-d7eb53cf-36ae-4a41-8f06-9d28881bec45 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:45.724685 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d7eb53cf-36ae-4a41-8f06-9d28881bec45 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:45.725250 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d7eb53cf-36ae-4a41-8f06-9d28881bec45 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:45.726687 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d7eb53cf-36ae-4a41-8f06-9d28881bec45 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:45.727148 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d7eb53cf-36ae-4a41-8f06-9d28881bec45 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:45.727672 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d7eb53cf-36ae-4a41-8f06-9d28881bec45 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:45.728121 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d7eb53cf-36ae-4a41-8f06-9d28881bec45 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:45.774024 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-d7eb53cf-36ae-4a41-8f06-9d28881bec45 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125531) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 19 00:47:45.776057 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-c935b64e-25c4-4444-bff7-969f439e8fa4 req-5f7b6ed4-7b83-4f24-83ad-83b7385f0bcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a48c163-1acb-4ff4-8f2e-b6b529707da4", "name": "network-vif-unplugged", "status": "completed", "tag": "3fc16ed1-ad15-4f2c-8cb0-7877e83842ab"}]} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:47:45.788899 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-c935b64e-25c4-4444-bff7-969f439e8fa4 req-5f7b6ed4-7b83-4f24-83ad-83b7385f0bcf service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:45.789965 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-c935b64e-25c4-4444-bff7-969f439e8fa4 req-5f7b6ed4-7b83-4f24-83ad-83b7385f0bcf service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:45.790609 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-c935b64e-25c4-4444-bff7-969f439e8fa4 req-5f7b6ed4-7b83-4f24-83ad-83b7385f0bcf service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:45.802030 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.compute.server_external_events [req-c935b64e-25c4-4444-bff7-969f439e8fa4 req-5f7b6ed4-7b83-4f24-83ad-83b7385f0bcf service nova] Unable to find a host for instance 7a48c163-1acb-4ff4-8f2e-b6b529707da4. Dropping event network-vif-unplugged {{(pid=125532) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 19 00:47:45.803038 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-c935b64e-25c4-4444-bff7-969f439e8fa4 req-5f7b6ed4-7b83-4f24-83ad-83b7385f0bcf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033211 Oct 19 00:47:45.803943 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 482/947] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 19 00:47:45.848731 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-d7eb53cf-36ae-4a41-8f06-9d28881bec45 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "POST /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4/action" status: 202 len: 0 microversion: 2.20 time: 0.135677 Oct 19 00:47:45.853137 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 466/948] 10.222.0.33 () {62 vars in 1319 bytes} [Wed Oct 19 00:47:45 2022] POST /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:47:45.858761 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-b4ca1e9e-bf33-4ead-a0dc-f6f1c8cca2c3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:45.859421 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-b4ca1e9e-bf33-4ead-a0dc-f6f1c8cca2c3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:45.866618 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b4ca1e9e-bf33-4ead-a0dc-f6f1c8cca2c3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:45.867891 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b4ca1e9e-bf33-4ead-a0dc-f6f1c8cca2c3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:45.867891 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b4ca1e9e-bf33-4ead-a0dc-f6f1c8cca2c3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:45.868901 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b4ca1e9e-bf33-4ead-a0dc-f6f1c8cca2c3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:45.869360 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b4ca1e9e-bf33-4ead-a0dc-f6f1c8cca2c3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:45.869789 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b4ca1e9e-bf33-4ead-a0dc-f6f1c8cca2c3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:46.003196 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-b4ca1e9e-bf33-4ead-a0dc-f6f1c8cca2c3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:46.011255 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-b4ca1e9e-bf33-4ead-a0dc-f6f1c8cca2c3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:46.012709 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-b4ca1e9e-bf33-4ead-a0dc-f6f1c8cca2c3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:46.013943 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-b4ca1e9e-bf33-4ead-a0dc-f6f1c8cca2c3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1671 microversion: 2.20 time: 0.159168 Oct 19 00:47:46.014512 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 483/949] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:45 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:47.041406 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-1d35ca8f-37dd-47eb-9019-e07a6f80515b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:47.041948 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-1d35ca8f-37dd-47eb-9019-e07a6f80515b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:47.048996 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1d35ca8f-37dd-47eb-9019-e07a6f80515b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:47.049520 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1d35ca8f-37dd-47eb-9019-e07a6f80515b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:47.050102 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1d35ca8f-37dd-47eb-9019-e07a6f80515b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:47.050798 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1d35ca8f-37dd-47eb-9019-e07a6f80515b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:47.051254 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1d35ca8f-37dd-47eb-9019-e07a6f80515b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:47.051679 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1d35ca8f-37dd-47eb-9019-e07a6f80515b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:47.195430 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-1d35ca8f-37dd-47eb-9019-e07a6f80515b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:47.203694 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-1d35ca8f-37dd-47eb-9019-e07a6f80515b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:47.205373 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-1d35ca8f-37dd-47eb-9019-e07a6f80515b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:47.206529 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-1d35ca8f-37dd-47eb-9019-e07a6f80515b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1673 microversion: 2.20 time: 0.170515 Oct 19 00:47:47.207079 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 467/950] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:47 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1673 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:48.232204 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-5a201742-3efe-4bc1-95b8-728ba635c7f9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:48.232851 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-5a201742-3efe-4bc1-95b8-728ba635c7f9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:48.239337 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5a201742-3efe-4bc1-95b8-728ba635c7f9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:48.239818 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5a201742-3efe-4bc1-95b8-728ba635c7f9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:48.240287 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5a201742-3efe-4bc1-95b8-728ba635c7f9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:48.241492 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5a201742-3efe-4bc1-95b8-728ba635c7f9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:48.241928 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5a201742-3efe-4bc1-95b8-728ba635c7f9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:48.242351 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5a201742-3efe-4bc1-95b8-728ba635c7f9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:48.263995 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:48.378494 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-5a201742-3efe-4bc1-95b8-728ba635c7f9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:48.388259 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-5a201742-3efe-4bc1-95b8-728ba635c7f9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:48.389886 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-5a201742-3efe-4bc1-95b8-728ba635c7f9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:48.391053 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-5a201742-3efe-4bc1-95b8-728ba635c7f9 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1729 microversion: 2.20 time: 0.162713 Oct 19 00:47:48.391613 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 484/951] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:48 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:49.415999 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-278f7c9b-70dc-436c-94c1-68df94898b50 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:49.416595 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-278f7c9b-70dc-436c-94c1-68df94898b50 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:49.423096 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-278f7c9b-70dc-436c-94c1-68df94898b50 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:49.423576 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-278f7c9b-70dc-436c-94c1-68df94898b50 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:49.424039 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-278f7c9b-70dc-436c-94c1-68df94898b50 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:49.424726 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-278f7c9b-70dc-436c-94c1-68df94898b50 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:49.425170 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-278f7c9b-70dc-436c-94c1-68df94898b50 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:49.425588 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-278f7c9b-70dc-436c-94c1-68df94898b50 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:49.571299 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-278f7c9b-70dc-436c-94c1-68df94898b50 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:49.579335 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-278f7c9b-70dc-436c-94c1-68df94898b50 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:49.580797 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-278f7c9b-70dc-436c-94c1-68df94898b50 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:49.581947 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-278f7c9b-70dc-436c-94c1-68df94898b50 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1729 microversion: 2.20 time: 0.170574 Oct 19 00:47:49.582494 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 468/952] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:49 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:50.614583 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-192883b4-e6ea-4f5e-a1ed-8a7b14004588 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:50.614583 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-192883b4-e6ea-4f5e-a1ed-8a7b14004588 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:50.618172 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-192883b4-e6ea-4f5e-a1ed-8a7b14004588 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:50.618172 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-192883b4-e6ea-4f5e-a1ed-8a7b14004588 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:50.618731 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-192883b4-e6ea-4f5e-a1ed-8a7b14004588 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:50.619625 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-192883b4-e6ea-4f5e-a1ed-8a7b14004588 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:50.620335 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-192883b4-e6ea-4f5e-a1ed-8a7b14004588 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:50.621864 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-192883b4-e6ea-4f5e-a1ed-8a7b14004588 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:50.775979 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-192883b4-e6ea-4f5e-a1ed-8a7b14004588 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:50.785495 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-192883b4-e6ea-4f5e-a1ed-8a7b14004588 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:50.787189 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-192883b4-e6ea-4f5e-a1ed-8a7b14004588 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:50.788736 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-192883b4-e6ea-4f5e-a1ed-8a7b14004588 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1729 microversion: 2.20 time: 0.182885 Oct 19 00:47:50.789456 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 485/953] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:50 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:47:51.814596 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-f34e9a9a-00c3-493f-aa89-ae825745ead3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:51.815265 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-f34e9a9a-00c3-493f-aa89-ae825745ead3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:51.821783 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f34e9a9a-00c3-493f-aa89-ae825745ead3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:51.822271 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f34e9a9a-00c3-493f-aa89-ae825745ead3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:51.822711 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f34e9a9a-00c3-493f-aa89-ae825745ead3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:51.823417 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f34e9a9a-00c3-493f-aa89-ae825745ead3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:51.823888 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f34e9a9a-00c3-493f-aa89-ae825745ead3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:51.824317 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f34e9a9a-00c3-493f-aa89-ae825745ead3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:51.969506 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-f34e9a9a-00c3-493f-aa89-ae825745ead3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:51.977884 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-f34e9a9a-00c3-493f-aa89-ae825745ead3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:51.980026 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-f34e9a9a-00c3-493f-aa89-ae825745ead3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:51.981227 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-f34e9a9a-00c3-493f-aa89-ae825745ead3 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1729 microversion: 2.20 time: 0.170556 Oct 19 00:47:51.995893 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 469/954] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:51 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:53.021799 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-4c738191-4c26-4c85-80df-834e88ea3801 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:53.023008 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-4c738191-4c26-4c85-80df-834e88ea3801 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:53.025949 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_api:SELECT=32 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:53.031242 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4c738191-4c26-4c85-80df-834e88ea3801 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:53.031722 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4c738191-4c26-4c85-80df-834e88ea3801 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:53.032260 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4c738191-4c26-4c85-80df-834e88ea3801 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:53.032977 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4c738191-4c26-4c85-80df-834e88ea3801 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:53.033427 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4c738191-4c26-4c85-80df-834e88ea3801 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:53.033849 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4c738191-4c26-4c85-80df-834e88ea3801 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:53.177303 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-4c738191-4c26-4c85-80df-834e88ea3801 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:53.185956 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-4c738191-4c26-4c85-80df-834e88ea3801 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:53.187379 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-4c738191-4c26-4c85-80df-834e88ea3801 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:53.188595 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-4c738191-4c26-4c85-80df-834e88ea3801 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1729 microversion: 2.20 time: 0.170824 Oct 19 00:47:53.189145 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 486/955] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:53 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:54.213808 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-009b30d2-7bbe-4dd7-ba97-05bd56c23cae tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:54.214462 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-009b30d2-7bbe-4dd7-ba97-05bd56c23cae tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:54.217059 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:54.223735 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-009b30d2-7bbe-4dd7-ba97-05bd56c23cae tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:54.224612 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-009b30d2-7bbe-4dd7-ba97-05bd56c23cae tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:54.225113 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-009b30d2-7bbe-4dd7-ba97-05bd56c23cae tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:54.225919 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-009b30d2-7bbe-4dd7-ba97-05bd56c23cae tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:54.226412 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-009b30d2-7bbe-4dd7-ba97-05bd56c23cae tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:54.226915 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-009b30d2-7bbe-4dd7-ba97-05bd56c23cae tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:54.379448 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-009b30d2-7bbe-4dd7-ba97-05bd56c23cae tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:54.388903 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-009b30d2-7bbe-4dd7-ba97-05bd56c23cae tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:54.391476 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-009b30d2-7bbe-4dd7-ba97-05bd56c23cae tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:54.393151 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-009b30d2-7bbe-4dd7-ba97-05bd56c23cae tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1729 microversion: 2.20 time: 0.183313 Oct 19 00:47:54.393821 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 470/956] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:54 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:55.420952 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-042cab1d-9068-4ca9-b8f2-f57fd07514b2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:55.421505 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-042cab1d-9068-4ca9-b8f2-f57fd07514b2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:55.428676 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-042cab1d-9068-4ca9-b8f2-f57fd07514b2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:55.429960 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-042cab1d-9068-4ca9-b8f2-f57fd07514b2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:55.430402 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-042cab1d-9068-4ca9-b8f2-f57fd07514b2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:55.431120 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-042cab1d-9068-4ca9-b8f2-f57fd07514b2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:55.431577 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-042cab1d-9068-4ca9-b8f2-f57fd07514b2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:55.432091 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-042cab1d-9068-4ca9-b8f2-f57fd07514b2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:55.570127 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-042cab1d-9068-4ca9-b8f2-f57fd07514b2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:55.581728 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-042cab1d-9068-4ca9-b8f2-f57fd07514b2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:55.583690 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-042cab1d-9068-4ca9-b8f2-f57fd07514b2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:55.585661 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-042cab1d-9068-4ca9-b8f2-f57fd07514b2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1729 microversion: 2.20 time: 0.168327 Oct 19 00:47:55.586324 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 487/957] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:55 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:56.612062 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-2c99c365-0298-4d95-97ed-ee0f8e8643d4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:56.612663 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-2c99c365-0298-4d95-97ed-ee0f8e8643d4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:56.620303 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2c99c365-0298-4d95-97ed-ee0f8e8643d4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:56.620787 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2c99c365-0298-4d95-97ed-ee0f8e8643d4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:56.621217 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2c99c365-0298-4d95-97ed-ee0f8e8643d4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:56.621908 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2c99c365-0298-4d95-97ed-ee0f8e8643d4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:56.622382 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2c99c365-0298-4d95-97ed-ee0f8e8643d4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:56.622815 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2c99c365-0298-4d95-97ed-ee0f8e8643d4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:56.763233 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-2c99c365-0298-4d95-97ed-ee0f8e8643d4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:56.771962 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-2c99c365-0298-4d95-97ed-ee0f8e8643d4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:56.773600 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-2c99c365-0298-4d95-97ed-ee0f8e8643d4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:56.774779 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-2c99c365-0298-4d95-97ed-ee0f8e8643d4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1729 microversion: 2.20 time: 0.166691 Oct 19 00:47:56.775451 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 471/958] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:56 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:57.802589 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-a76518de-c275-4aa1-ad55-21d75f77b07b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:57.803269 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-a76518de-c275-4aa1-ad55-21d75f77b07b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:57.810950 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a76518de-c275-4aa1-ad55-21d75f77b07b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:57.811464 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a76518de-c275-4aa1-ad55-21d75f77b07b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:57.811985 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a76518de-c275-4aa1-ad55-21d75f77b07b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:57.812701 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a76518de-c275-4aa1-ad55-21d75f77b07b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:57.813147 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a76518de-c275-4aa1-ad55-21d75f77b07b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:57.813563 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a76518de-c275-4aa1-ad55-21d75f77b07b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:57.949913 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-a76518de-c275-4aa1-ad55-21d75f77b07b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:57.957957 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-a76518de-c275-4aa1-ad55-21d75f77b07b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:57.959377 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-a76518de-c275-4aa1-ad55-21d75f77b07b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:57.960667 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-a76518de-c275-4aa1-ad55-21d75f77b07b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1729 microversion: 2.20 time: 0.163516 Oct 19 00:47:57.961225 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 488/959] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:57 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:58.985910 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-13e69322-8ede-499b-9bfc-feee9cd257df tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:58.986550 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-13e69322-8ede-499b-9bfc-feee9cd257df tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:58.993370 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-13e69322-8ede-499b-9bfc-feee9cd257df tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:58.994101 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-13e69322-8ede-499b-9bfc-feee9cd257df tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:58.994531 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-13e69322-8ede-499b-9bfc-feee9cd257df tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:58.995211 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-13e69322-8ede-499b-9bfc-feee9cd257df tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:58.995662 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-13e69322-8ede-499b-9bfc-feee9cd257df tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:58.996108 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-13e69322-8ede-499b-9bfc-feee9cd257df tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:59.132643 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-13e69322-8ede-499b-9bfc-feee9cd257df tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:59.146073 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-13e69322-8ede-499b-9bfc-feee9cd257df tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:59.148151 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-13e69322-8ede-499b-9bfc-feee9cd257df tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:59.149330 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-13e69322-8ede-499b-9bfc-feee9cd257df tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1729 microversion: 2.20 time: 0.167380 Oct 19 00:47:59.149883 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 472/960] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:58 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:00.175037 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-d9d49f4e-2004-4382-b1c0-ff0afe9ba552 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:00.175761 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-d9d49f4e-2004-4382-b1c0-ff0afe9ba552 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:00.183585 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d9d49f4e-2004-4382-b1c0-ff0afe9ba552 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:00.184168 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d9d49f4e-2004-4382-b1c0-ff0afe9ba552 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:00.184702 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d9d49f4e-2004-4382-b1c0-ff0afe9ba552 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:00.185473 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d9d49f4e-2004-4382-b1c0-ff0afe9ba552 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:00.185973 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d9d49f4e-2004-4382-b1c0-ff0afe9ba552 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:00.186443 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d9d49f4e-2004-4382-b1c0-ff0afe9ba552 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:00.315289 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-d9d49f4e-2004-4382-b1c0-ff0afe9ba552 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:00.324070 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-d9d49f4e-2004-4382-b1c0-ff0afe9ba552 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:00.325574 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-d9d49f4e-2004-4382-b1c0-ff0afe9ba552 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:00.326774 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-d9d49f4e-2004-4382-b1c0-ff0afe9ba552 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1729 microversion: 2.20 time: 0.156232 Oct 19 00:48:00.327318 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 489/961] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:00 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:01.352149 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-a138fc8b-94d0-4720-bfca-be3e029bd476 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:01.352764 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-a138fc8b-94d0-4720-bfca-be3e029bd476 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:01.359638 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a138fc8b-94d0-4720-bfca-be3e029bd476 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:01.360427 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a138fc8b-94d0-4720-bfca-be3e029bd476 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:01.361121 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a138fc8b-94d0-4720-bfca-be3e029bd476 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:01.361919 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a138fc8b-94d0-4720-bfca-be3e029bd476 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:01.362372 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a138fc8b-94d0-4720-bfca-be3e029bd476 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:01.362797 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a138fc8b-94d0-4720-bfca-be3e029bd476 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:01.493119 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-a138fc8b-94d0-4720-bfca-be3e029bd476 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:01.501538 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-a138fc8b-94d0-4720-bfca-be3e029bd476 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:01.502995 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-a138fc8b-94d0-4720-bfca-be3e029bd476 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:01.504186 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-a138fc8b-94d0-4720-bfca-be3e029bd476 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1729 microversion: 2.20 time: 0.156239 Oct 19 00:48:01.504740 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 473/962] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:01 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:02.530425 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-104aac21-4054-407a-b960-7c7ecb8aaf2e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:02.531038 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-104aac21-4054-407a-b960-7c7ecb8aaf2e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:02.537462 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-104aac21-4054-407a-b960-7c7ecb8aaf2e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:02.537970 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-104aac21-4054-407a-b960-7c7ecb8aaf2e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:02.538392 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-104aac21-4054-407a-b960-7c7ecb8aaf2e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:02.540698 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-104aac21-4054-407a-b960-7c7ecb8aaf2e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:02.541160 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-104aac21-4054-407a-b960-7c7ecb8aaf2e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:02.541589 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-104aac21-4054-407a-b960-7c7ecb8aaf2e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:02.691284 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-104aac21-4054-407a-b960-7c7ecb8aaf2e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:02.700322 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-104aac21-4054-407a-b960-7c7ecb8aaf2e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:02.701822 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-104aac21-4054-407a-b960-7c7ecb8aaf2e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:02.702996 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-104aac21-4054-407a-b960-7c7ecb8aaf2e tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1729 microversion: 2.20 time: 0.176553 Oct 19 00:48:02.703553 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 490/963] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:02 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:03.728914 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-7d8c6e47-9cc3-44d5-9489-c77ce82a76c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:03.729519 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-7d8c6e47-9cc3-44d5-9489-c77ce82a76c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:03.736147 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7d8c6e47-9cc3-44d5-9489-c77ce82a76c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:03.736632 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7d8c6e47-9cc3-44d5-9489-c77ce82a76c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:03.737088 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7d8c6e47-9cc3-44d5-9489-c77ce82a76c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:03.737763 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7d8c6e47-9cc3-44d5-9489-c77ce82a76c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:03.738213 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7d8c6e47-9cc3-44d5-9489-c77ce82a76c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:03.738662 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7d8c6e47-9cc3-44d5-9489-c77ce82a76c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:03.754172 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:03.876967 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-7d8c6e47-9cc3-44d5-9489-c77ce82a76c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:03.886061 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-7d8c6e47-9cc3-44d5-9489-c77ce82a76c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:03.887607 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-7d8c6e47-9cc3-44d5-9489-c77ce82a76c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:03.889120 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-7d8c6e47-9cc3-44d5-9489-c77ce82a76c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1729 microversion: 2.20 time: 0.164609 Oct 19 00:48:03.889684 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 474/964] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:03 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:04.913911 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-75b61bf0-f293-410d-8816-c9c4f2a09c66 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:04.914434 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-75b61bf0-f293-410d-8816-c9c4f2a09c66 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:04.921763 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-75b61bf0-f293-410d-8816-c9c4f2a09c66 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:04.922261 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-75b61bf0-f293-410d-8816-c9c4f2a09c66 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:04.922690 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-75b61bf0-f293-410d-8816-c9c4f2a09c66 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:04.923394 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-75b61bf0-f293-410d-8816-c9c4f2a09c66 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:04.923844 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-75b61bf0-f293-410d-8816-c9c4f2a09c66 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:04.924283 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-75b61bf0-f293-410d-8816-c9c4f2a09c66 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:05.056491 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-75b61bf0-f293-410d-8816-c9c4f2a09c66 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:05.064512 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-75b61bf0-f293-410d-8816-c9c4f2a09c66 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:05.065943 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-75b61bf0-f293-410d-8816-c9c4f2a09c66 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:05.067087 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-75b61bf0-f293-410d-8816-c9c4f2a09c66 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1729 microversion: 2.20 time: 0.157281 Oct 19 00:48:05.067645 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 491/965] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:04 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:05.851607 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-3c908ba5-f865-4cd7-8282-52ccb20a6fb2 req-e02ab752-2338-4016-aa25-967193a68028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a48c163-1acb-4ff4-8f2e-b6b529707da4", "name": "network-vif-plugged", "status": "completed", "tag": "3fc16ed1-ad15-4f2c-8cb0-7877e83842ab"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:05.863058 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-3c908ba5-f865-4cd7-8282-52ccb20a6fb2 req-e02ab752-2338-4016-aa25-967193a68028 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:05.863538 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-3c908ba5-f865-4cd7-8282-52ccb20a6fb2 req-e02ab752-2338-4016-aa25-967193a68028 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:05.864002 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-3c908ba5-f865-4cd7-8282-52ccb20a6fb2 req-e02ab752-2338-4016-aa25-967193a68028 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:05.876979 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-3c908ba5-f865-4cd7-8282-52ccb20a6fb2 req-e02ab752-2338-4016-aa25-967193a68028 service nova] Creating event network-vif-plugged:3fc16ed1-ad15-4f2c-8cb0-7877e83842ab for instance 7a48c163-1acb-4ff4-8f2e-b6b529707da4 on hv-cinder-maste Oct 19 00:48:05.882002 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-3c908ba5-f865-4cd7-8282-52ccb20a6fb2 req-e02ab752-2338-4016-aa25-967193a68028 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034039 Oct 19 00:48:05.882595 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 475/966] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:06.093279 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-206c9447-5e72-4f4f-b2bf-c73842ed53c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:06.093874 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-206c9447-5e72-4f4f-b2bf-c73842ed53c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:06.100341 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-206c9447-5e72-4f4f-b2bf-c73842ed53c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:06.100817 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-206c9447-5e72-4f4f-b2bf-c73842ed53c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:06.101249 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-206c9447-5e72-4f4f-b2bf-c73842ed53c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:06.101936 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-206c9447-5e72-4f4f-b2bf-c73842ed53c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:06.103515 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-206c9447-5e72-4f4f-b2bf-c73842ed53c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:06.103974 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-206c9447-5e72-4f4f-b2bf-c73842ed53c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:06.261404 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-206c9447-5e72-4f4f-b2bf-c73842ed53c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:06.269477 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-206c9447-5e72-4f4f-b2bf-c73842ed53c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:06.270949 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-206c9447-5e72-4f4f-b2bf-c73842ed53c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:06.272152 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-206c9447-5e72-4f4f-b2bf-c73842ed53c6 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1729 microversion: 2.20 time: 0.182790 Oct 19 00:48:06.272900 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 492/967] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:06 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:07.299609 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-89893645-099b-4590-8ed5-0c6c784e76da tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:07.300337 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-89893645-099b-4590-8ed5-0c6c784e76da tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:07.307209 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-89893645-099b-4590-8ed5-0c6c784e76da tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:07.307696 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-89893645-099b-4590-8ed5-0c6c784e76da tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:07.308233 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-89893645-099b-4590-8ed5-0c6c784e76da tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:07.308930 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-89893645-099b-4590-8ed5-0c6c784e76da tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:07.309386 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-89893645-099b-4590-8ed5-0c6c784e76da tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:07.309816 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-89893645-099b-4590-8ed5-0c6c784e76da tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:07.438321 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-89893645-099b-4590-8ed5-0c6c784e76da tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:07.447097 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-89893645-099b-4590-8ed5-0c6c784e76da tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:07.448617 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-89893645-099b-4590-8ed5-0c6c784e76da tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:07.449781 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-89893645-099b-4590-8ed5-0c6c784e76da tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1729 microversion: 2.20 time: 0.155087 Oct 19 00:48:07.450338 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 476/968] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:07 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:08.474952 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-02a450ab-57d7-4ca0-9b75-b37cd3f9be8d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:08.475572 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-02a450ab-57d7-4ca0-9b75-b37cd3f9be8d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:08.482774 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-02a450ab-57d7-4ca0-9b75-b37cd3f9be8d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:08.483259 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-02a450ab-57d7-4ca0-9b75-b37cd3f9be8d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:08.483698 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-02a450ab-57d7-4ca0-9b75-b37cd3f9be8d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:08.484447 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-02a450ab-57d7-4ca0-9b75-b37cd3f9be8d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:08.484907 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-02a450ab-57d7-4ca0-9b75-b37cd3f9be8d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:08.485334 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-02a450ab-57d7-4ca0-9b75-b37cd3f9be8d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:08.627117 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-02a450ab-57d7-4ca0-9b75-b37cd3f9be8d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:08.635969 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-02a450ab-57d7-4ca0-9b75-b37cd3f9be8d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:08.637417 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-02a450ab-57d7-4ca0-9b75-b37cd3f9be8d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:08.638584 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-02a450ab-57d7-4ca0-9b75-b37cd3f9be8d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1729 microversion: 2.20 time: 0.167688 Oct 19 00:48:08.639148 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 493/969] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:08 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:09.664278 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-581ce248-ee35-4c74-bea7-8864abb06659 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:09.664910 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-581ce248-ee35-4c74-bea7-8864abb06659 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:09.671233 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-581ce248-ee35-4c74-bea7-8864abb06659 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:09.671743 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-581ce248-ee35-4c74-bea7-8864abb06659 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:09.672221 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-581ce248-ee35-4c74-bea7-8864abb06659 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:09.672909 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-581ce248-ee35-4c74-bea7-8864abb06659 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:09.673358 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-581ce248-ee35-4c74-bea7-8864abb06659 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:09.673781 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-581ce248-ee35-4c74-bea7-8864abb06659 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:09.805719 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-581ce248-ee35-4c74-bea7-8864abb06659 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:09.814480 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-581ce248-ee35-4c74-bea7-8864abb06659 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:09.815953 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-581ce248-ee35-4c74-bea7-8864abb06659 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:09.817108 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-581ce248-ee35-4c74-bea7-8864abb06659 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1716 microversion: 2.20 time: 0.157029 Oct 19 00:48:09.817713 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 477/970] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:09 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:11.224329 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-4e9ff353-ad98-41f2-8d31-d76b1b1572c4 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:11.224860 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-4e9ff353-ad98-41f2-8d31-d76b1b1572c4 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: 79139e42-0238-4e80-8a53-b00cb59e03f0] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:11.231800 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4e9ff353-ad98-41f2-8d31-d76b1b1572c4 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:11.232306 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4e9ff353-ad98-41f2-8d31-d76b1b1572c4 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:11.232743 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4e9ff353-ad98-41f2-8d31-d76b1b1572c4 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:11.233431 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4e9ff353-ad98-41f2-8d31-d76b1b1572c4 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:11.233893 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4e9ff353-ad98-41f2-8d31-d76b1b1572c4 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:11.234317 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4e9ff353-ad98-41f2-8d31-d76b1b1572c4 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:11.257817 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-4e9ff353-ad98-41f2-8d31-d76b1b1572c4 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0/ips" status: 200 len: 145 microversion: 2.1 time: 0.037380 Oct 19 00:48:11.258366 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 494/971] 10.222.0.33 () {58 vars in 1248 bytes} [Wed Oct 19 00:48:11 2022] GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:12.589391 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-d2c8bce8-8403-425d-a61a-b106ae258289 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43e701e0-69b4-4513-bd68-89db94078bc8"}} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:12.591798 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-d2c8bce8-8403-425d-a61a-b106ae258289 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: 79139e42-0238-4e80-8a53-b00cb59e03f0] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:12.598590 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d2c8bce8-8403-425d-a61a-b106ae258289 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:12.599072 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d2c8bce8-8403-425d-a61a-b106ae258289 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:12.599509 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d2c8bce8-8403-425d-a61a-b106ae258289 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:12.600241 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d2c8bce8-8403-425d-a61a-b106ae258289 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:12.600728 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d2c8bce8-8403-425d-a61a-b106ae258289 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:12.601150 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d2c8bce8-8403-425d-a61a-b106ae258289 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:12.893074 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-d2c8bce8-8403-425d-a61a-b106ae258289 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "POST /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308001 Oct 19 00:48:12.893730 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 478/972] 10.222.0.33 () {60 vars in 1323 bytes} [Wed Oct 19 00:48:12 2022] POST /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:15.145945 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-783bb93c-faec-4267-a446-dd092ae8ebee tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:15.148200 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-783bb93c-faec-4267-a446-dd092ae8ebee tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: 79139e42-0238-4e80-8a53-b00cb59e03f0] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:15.155090 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-783bb93c-faec-4267-a446-dd092ae8ebee tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:15.155571 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-783bb93c-faec-4267-a446-dd092ae8ebee tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:15.156068 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-783bb93c-faec-4267-a446-dd092ae8ebee tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:15.156768 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-783bb93c-faec-4267-a446-dd092ae8ebee tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:15.157228 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-783bb93c-faec-4267-a446-dd092ae8ebee tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:15.157659 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-783bb93c-faec-4267-a446-dd092ae8ebee tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:15.187092 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-783bb93c-faec-4267-a446-dd092ae8ebee tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045082 Oct 19 00:48:15.187640 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 495/973] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Oct 19 00:48:15 2022] GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:15.198899 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-6a715f9e-c9ce-4a39-b94d-512166406bad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:15.199478 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-6a715f9e-c9ce-4a39-b94d-512166406bad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: 79139e42-0238-4e80-8a53-b00cb59e03f0] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:15.206154 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6a715f9e-c9ce-4a39-b94d-512166406bad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:15.206632 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6a715f9e-c9ce-4a39-b94d-512166406bad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:15.207068 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6a715f9e-c9ce-4a39-b94d-512166406bad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:15.207777 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6a715f9e-c9ce-4a39-b94d-512166406bad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:15.208241 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6a715f9e-c9ce-4a39-b94d-512166406bad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:15.208671 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6a715f9e-c9ce-4a39-b94d-512166406bad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:15.237767 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-6a715f9e-c9ce-4a39-b94d-512166406bad tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0/os-volume_attachments/43e701e0-69b4-4513-bd68-89db94078bc8" status: 200 len: 194 microversion: 2.1 time: 0.043202 Oct 19 00:48:15.238336 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 479/974] 10.222.0.33 () {58 vars in 1413 bytes} [Wed Oct 19 00:48:15 2022] GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0/os-volume_attachments/43e701e0-69b4-4513-bd68-89db94078bc8 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:16.566609 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-46a021e9-2db1-4e2c-8b6c-05ce51fe0e9c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6555e009-b5eb-492c-a396-6a68c453eee0"}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:16.568977 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-46a021e9-2db1-4e2c-8b6c-05ce51fe0e9c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: 79139e42-0238-4e80-8a53-b00cb59e03f0] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:16.575612 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-46a021e9-2db1-4e2c-8b6c-05ce51fe0e9c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:16.576141 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-46a021e9-2db1-4e2c-8b6c-05ce51fe0e9c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:16.576573 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-46a021e9-2db1-4e2c-8b6c-05ce51fe0e9c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:16.577261 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-46a021e9-2db1-4e2c-8b6c-05ce51fe0e9c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:16.577714 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-46a021e9-2db1-4e2c-8b6c-05ce51fe0e9c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:16.578135 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-46a021e9-2db1-4e2c-8b6c-05ce51fe0e9c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:16.838738 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-46a021e9-2db1-4e2c-8b6c-05ce51fe0e9c tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "POST /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275266 Oct 19 00:48:16.839344 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 496/975] 10.222.0.33 () {60 vars in 1323 bytes} [Wed Oct 19 00:48:16 2022] POST /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:19.081796 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-ee64d257-61a7-45f1-8cf5-22bddda42e84 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:19.084138 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-ee64d257-61a7-45f1-8cf5-22bddda42e84 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: 79139e42-0238-4e80-8a53-b00cb59e03f0] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:19.090909 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ee64d257-61a7-45f1-8cf5-22bddda42e84 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:19.091391 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ee64d257-61a7-45f1-8cf5-22bddda42e84 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:19.091823 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ee64d257-61a7-45f1-8cf5-22bddda42e84 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:19.092543 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ee64d257-61a7-45f1-8cf5-22bddda42e84 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:19.092999 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ee64d257-61a7-45f1-8cf5-22bddda42e84 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:19.093420 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ee64d257-61a7-45f1-8cf5-22bddda42e84 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:19.124838 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-ee64d257-61a7-45f1-8cf5-22bddda42e84 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046972 Oct 19 00:48:19.125388 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 480/976] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Oct 19 00:48:19 2022] GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:19.265691 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-712d3d79-32b9-4a78-895c-0c4d014245ff tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:19.266222 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-712d3d79-32b9-4a78-895c-0c4d014245ff tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: 79139e42-0238-4e80-8a53-b00cb59e03f0] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:19.272512 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-712d3d79-32b9-4a78-895c-0c4d014245ff tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:19.272997 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-712d3d79-32b9-4a78-895c-0c4d014245ff tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:19.273434 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-712d3d79-32b9-4a78-895c-0c4d014245ff tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:19.274126 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-712d3d79-32b9-4a78-895c-0c4d014245ff tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:19.274586 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-712d3d79-32b9-4a78-895c-0c4d014245ff tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:19.275009 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-712d3d79-32b9-4a78-895c-0c4d014245ff tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:19.277687 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:19.305845 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-712d3d79-32b9-4a78-895c-0c4d014245ff tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0/os-volume_attachments/43e701e0-69b4-4513-bd68-89db94078bc8" status: 200 len: 194 microversion: 2.1 time: 0.045334 Oct 19 00:48:19.306417 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 497/977] 10.222.0.33 () {58 vars in 1413 bytes} [Wed Oct 19 00:48:19 2022] GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0/os-volume_attachments/43e701e0-69b4-4513-bd68-89db94078bc8 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:19.317387 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-f84311b0-d550-4fc5-ba11-1cd89efc315d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:19.317873 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-f84311b0-d550-4fc5-ba11-1cd89efc315d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: 79139e42-0238-4e80-8a53-b00cb59e03f0] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:19.324485 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f84311b0-d550-4fc5-ba11-1cd89efc315d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:19.324962 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f84311b0-d550-4fc5-ba11-1cd89efc315d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:19.325393 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f84311b0-d550-4fc5-ba11-1cd89efc315d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:19.326076 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f84311b0-d550-4fc5-ba11-1cd89efc315d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:19.326536 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f84311b0-d550-4fc5-ba11-1cd89efc315d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:19.326949 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-f84311b0-d550-4fc5-ba11-1cd89efc315d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:19.410419 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.objects.instance [None req-f84311b0-d550-4fc5-ba11-1cd89efc315d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lazy-loading 'services' on Instance uuid 79139e42-0238-4e80-8a53-b00cb59e03f0 {{(pid=125531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:48:19.484175 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-f84311b0-d550-4fc5-ba11-1cd89efc315d tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "DELETE /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0/os-volume_attachments/43e701e0-69b4-4513-bd68-89db94078bc8" status: 202 len: 0 microversion: 2.1 time: 0.170405 Oct 19 00:48:19.484784 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 481/978] 10.222.0.33 () {58 vars in 1416 bytes} [Wed Oct 19 00:48:19 2022] DELETE /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0/os-volume_attachments/43e701e0-69b4-4513-bd68-89db94078bc8 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:48:21.669454 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-61db87db-3363-4c36-9c79-e42458e6642b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:21.669976 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-61db87db-3363-4c36-9c79-e42458e6642b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: 79139e42-0238-4e80-8a53-b00cb59e03f0] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:21.676292 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-61db87db-3363-4c36-9c79-e42458e6642b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:21.676775 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-61db87db-3363-4c36-9c79-e42458e6642b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:21.677210 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-61db87db-3363-4c36-9c79-e42458e6642b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:21.677930 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-61db87db-3363-4c36-9c79-e42458e6642b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:21.678385 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-61db87db-3363-4c36-9c79-e42458e6642b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:21.678809 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-61db87db-3363-4c36-9c79-e42458e6642b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:21.708301 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-61db87db-3363-4c36-9c79-e42458e6642b tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0/os-volume_attachments/6555e009-b5eb-492c-a396-6a68c453eee0" status: 200 len: 194 microversion: 2.1 time: 0.043196 Oct 19 00:48:21.708876 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 498/979] 10.222.0.33 () {58 vars in 1413 bytes} [Wed Oct 19 00:48:21 2022] GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0/os-volume_attachments/6555e009-b5eb-492c-a396-6a68c453eee0 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:21.720616 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-34c86ba5-2d38-4e18-88aa-77c62e15eceb tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:21.721203 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-34c86ba5-2d38-4e18-88aa-77c62e15eceb tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: 79139e42-0238-4e80-8a53-b00cb59e03f0] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:21.727457 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-34c86ba5-2d38-4e18-88aa-77c62e15eceb tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:21.727983 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-34c86ba5-2d38-4e18-88aa-77c62e15eceb tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:21.728425 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-34c86ba5-2d38-4e18-88aa-77c62e15eceb tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:21.729120 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-34c86ba5-2d38-4e18-88aa-77c62e15eceb tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:21.730250 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-34c86ba5-2d38-4e18-88aa-77c62e15eceb tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:21.730681 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-34c86ba5-2d38-4e18-88aa-77c62e15eceb tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:21.810823 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.objects.instance [None req-34c86ba5-2d38-4e18-88aa-77c62e15eceb tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lazy-loading 'services' on Instance uuid 79139e42-0238-4e80-8a53-b00cb59e03f0 {{(pid=125531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:48:21.882472 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-34c86ba5-2d38-4e18-88aa-77c62e15eceb tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "DELETE /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0/os-volume_attachments/6555e009-b5eb-492c-a396-6a68c453eee0" status: 202 len: 0 microversion: 2.1 time: 0.166651 Oct 19 00:48:21.883240 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 482/980] 10.222.0.33 () {58 vars in 1416 bytes} [Wed Oct 19 00:48:21 2022] DELETE /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0/os-volume_attachments/6555e009-b5eb-492c-a396-6a68c453eee0 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:48:23.054335 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-f0f679e5-50c3-492e-9802-f21646d0fffb tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:23.056653 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-f0f679e5-50c3-492e-9802-f21646d0fffb tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: 79139e42-0238-4e80-8a53-b00cb59e03f0] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:23.059511 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_api:SELECT=26 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:23.064848 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f0f679e5-50c3-492e-9802-f21646d0fffb tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:23.065332 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f0f679e5-50c3-492e-9802-f21646d0fffb tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:23.065770 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f0f679e5-50c3-492e-9802-f21646d0fffb tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:23.066464 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f0f679e5-50c3-492e-9802-f21646d0fffb tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:23.066926 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f0f679e5-50c3-492e-9802-f21646d0fffb tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:23.067353 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f0f679e5-50c3-492e-9802-f21646d0fffb tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:23.095924 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-f0f679e5-50c3-492e-9802-f21646d0fffb tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045462 Oct 19 00:48:23.096478 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 499/981] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Oct 19 00:48:23 2022] GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:48:23.211825 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-ede21179-e0a3-4f7a-9d31-9a2cb2bf75d9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:23.214277 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-ede21179-e0a3-4f7a-9d31-9a2cb2bf75d9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: 79139e42-0238-4e80-8a53-b00cb59e03f0] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:23.220447 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ede21179-e0a3-4f7a-9d31-9a2cb2bf75d9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:23.220931 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ede21179-e0a3-4f7a-9d31-9a2cb2bf75d9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:23.221369 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ede21179-e0a3-4f7a-9d31-9a2cb2bf75d9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:23.222057 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ede21179-e0a3-4f7a-9d31-9a2cb2bf75d9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:23.222511 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ede21179-e0a3-4f7a-9d31-9a2cb2bf75d9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:23.222935 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-ede21179-e0a3-4f7a-9d31-9a2cb2bf75d9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:23.252682 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-ede21179-e0a3-4f7a-9d31-9a2cb2bf75d9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045649 Oct 19 00:48:23.253226 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 483/982] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Oct 19 00:48:23 2022] GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:48:23.315018 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-1eafaf7a-6cfb-4270-ad97-68148c032edd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:23.315508 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-1eafaf7a-6cfb-4270-ad97-68148c032edd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: 79139e42-0238-4e80-8a53-b00cb59e03f0] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:23.321375 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1eafaf7a-6cfb-4270-ad97-68148c032edd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:23.321852 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1eafaf7a-6cfb-4270-ad97-68148c032edd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:23.322279 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1eafaf7a-6cfb-4270-ad97-68148c032edd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:23.323001 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1eafaf7a-6cfb-4270-ad97-68148c032edd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:23.323529 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1eafaf7a-6cfb-4270-ad97-68148c032edd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:23.323984 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-1eafaf7a-6cfb-4270-ad97-68148c032edd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:23.348782 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-1eafaf7a-6cfb-4270-ad97-68148c032edd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: 79139e42-0238-4e80-8a53-b00cb59e03f0] Going to try to terminate instance {{(pid=125532) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:48:23.421736 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-1eafaf7a-6cfb-4270-ad97-68148c032edd tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "DELETE /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0" status: 204 len: 0 microversion: 2.1 time: 0.110139 Oct 19 00:48:23.422312 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 500/983] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Oct 19 00:48:23 2022] DELETE /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:48:23.431345 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-7c4db0be-b5e1-4566-a9dd-528ab620ab5f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:23.432017 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-7c4db0be-b5e1-4566-a9dd-528ab620ab5f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: 79139e42-0238-4e80-8a53-b00cb59e03f0] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:23.438032 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7c4db0be-b5e1-4566-a9dd-528ab620ab5f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:23.438516 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7c4db0be-b5e1-4566-a9dd-528ab620ab5f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:23.438974 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7c4db0be-b5e1-4566-a9dd-528ab620ab5f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:23.439645 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7c4db0be-b5e1-4566-a9dd-528ab620ab5f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:23.440133 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7c4db0be-b5e1-4566-a9dd-528ab620ab5f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:23.440557 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7c4db0be-b5e1-4566-a9dd-528ab620ab5f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:23.568488 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-7c4db0be-b5e1-4566-a9dd-528ab620ab5f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:23.576165 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-7c4db0be-b5e1-4566-a9dd-528ab620ab5f tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0" status: 200 len: 1672 microversion: 2.1 time: 0.148845 Oct 19 00:48:23.576727 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 484/984] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:23 2022] GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0 => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:24.600534 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-e2c4c553-2349-4d41-9c74-a793cb3d02f9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:24.601241 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-e2c4c553-2349-4d41-9c74-a793cb3d02f9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: 79139e42-0238-4e80-8a53-b00cb59e03f0] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:24.608315 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e2c4c553-2349-4d41-9c74-a793cb3d02f9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:24.608800 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e2c4c553-2349-4d41-9c74-a793cb3d02f9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:24.609236 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e2c4c553-2349-4d41-9c74-a793cb3d02f9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:24.609934 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e2c4c553-2349-4d41-9c74-a793cb3d02f9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:24.610391 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e2c4c553-2349-4d41-9c74-a793cb3d02f9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:24.610815 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e2c4c553-2349-4d41-9c74-a793cb3d02f9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:24.742178 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-e2c4c553-2349-4d41-9c74-a793cb3d02f9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:24.750971 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-e2c4c553-2349-4d41-9c74-a793cb3d02f9 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0" status: 200 len: 1672 microversion: 2.1 time: 0.154690 Oct 19 00:48:24.751544 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 501/985] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:24 2022] GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:25.773930 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-fb319a85-4004-48cd-8e77-201e083e2113 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:25.774539 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-fb319a85-4004-48cd-8e77-201e083e2113 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: 79139e42-0238-4e80-8a53-b00cb59e03f0] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:25.777286 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_api:SELECT=30 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:25.782576 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fb319a85-4004-48cd-8e77-201e083e2113 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:25.783052 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fb319a85-4004-48cd-8e77-201e083e2113 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:25.783481 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fb319a85-4004-48cd-8e77-201e083e2113 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:25.784257 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fb319a85-4004-48cd-8e77-201e083e2113 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:25.784716 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fb319a85-4004-48cd-8e77-201e083e2113 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:25.785165 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-fb319a85-4004-48cd-8e77-201e083e2113 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:25.916165 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-fb319a85-4004-48cd-8e77-201e083e2113 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:25.924530 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-fb319a85-4004-48cd-8e77-201e083e2113 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0" status: 200 len: 1672 microversion: 2.1 time: 0.154437 Oct 19 00:48:25.925096 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 485/986] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:25 2022] GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:26.577827 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-f6942bd5-4d5b-4767-8565-1d9e4a205a39 req-c35b77f0-5cbb-4460-be36-932df50bfbcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79139e42-0238-4e80-8a53-b00cb59e03f0", "name": "network-vif-deleted", "tag": "04cb5aa4-0534-4cce-9ce2-bdd3bc7a0f42"}]} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:26.589993 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-f6942bd5-4d5b-4767-8565-1d9e4a205a39 req-c35b77f0-5cbb-4460-be36-932df50bfbcd service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:26.590648 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-f6942bd5-4d5b-4767-8565-1d9e4a205a39 req-c35b77f0-5cbb-4460-be36-932df50bfbcd service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:26.591203 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-f6942bd5-4d5b-4767-8565-1d9e4a205a39 req-c35b77f0-5cbb-4460-be36-932df50bfbcd service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:26.607515 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.compute.server_external_events [req-f6942bd5-4d5b-4767-8565-1d9e4a205a39 req-c35b77f0-5cbb-4460-be36-932df50bfbcd service nova] Creating event network-vif-deleted:04cb5aa4-0534-4cce-9ce2-bdd3bc7a0f42 for instance 79139e42-0238-4e80-8a53-b00cb59e03f0 on hv-cinder-maste Oct 19 00:48:26.614683 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-f6942bd5-4d5b-4767-8565-1d9e4a205a39 req-c35b77f0-5cbb-4460-be36-932df50bfbcd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040448 Oct 19 00:48:26.615672 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 502/987] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:26.949141 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-1ffbbba4-46b0-43a0-985f-ad3b8a4386f0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:26.949841 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-1ffbbba4-46b0-43a0-985f-ad3b8a4386f0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: 79139e42-0238-4e80-8a53-b00cb59e03f0] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:26.956540 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1ffbbba4-46b0-43a0-985f-ad3b8a4386f0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:26.957027 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1ffbbba4-46b0-43a0-985f-ad3b8a4386f0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:26.957464 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1ffbbba4-46b0-43a0-985f-ad3b8a4386f0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:26.958168 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1ffbbba4-46b0-43a0-985f-ad3b8a4386f0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:26.958625 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1ffbbba4-46b0-43a0-985f-ad3b8a4386f0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:26.959050 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1ffbbba4-46b0-43a0-985f-ad3b8a4386f0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:26.990319 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1ffbbba4-46b0-43a0-985f-ad3b8a4386f0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:26.990806 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1ffbbba4-46b0-43a0-985f-ad3b8a4386f0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:26.991242 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-1ffbbba4-46b0-43a0-985f-ad3b8a4386f0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:26.991690 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.objects.instance [None req-1ffbbba4-46b0-43a0-985f-ad3b8a4386f0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lazy-loading 'fault' on Instance uuid 79139e42-0238-4e80-8a53-b00cb59e03f0 {{(pid=125531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:48:27.036183 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-1ffbbba4-46b0-43a0-985f-ad3b8a4386f0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacade278860491a9eac6f86b9b2a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f150d0c748e54c3eb4943b2b41adb99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:27.044745 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-1ffbbba4-46b0-43a0-985f-ad3b8a4386f0 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0" status: 200 len: 1326 microversion: 2.1 time: 0.100485 Oct 19 00:48:27.045319 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 486/988] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:26 2022] GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0 => generated 1326 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:28.069525 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-9594c727-c518-4104-aa1e-c81df00c6255 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:28.070232 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-9594c727-c518-4104-aa1e-c81df00c6255 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: 79139e42-0238-4e80-8a53-b00cb59e03f0] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:28.076589 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9594c727-c518-4104-aa1e-c81df00c6255 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:28.077078 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9594c727-c518-4104-aa1e-c81df00c6255 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:28.077517 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9594c727-c518-4104-aa1e-c81df00c6255 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:28.078211 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9594c727-c518-4104-aa1e-c81df00c6255 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:28.078671 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9594c727-c518-4104-aa1e-c81df00c6255 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:28.079106 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9594c727-c518-4104-aa1e-c81df00c6255 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:28.093013 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.wsgi [None req-9594c727-c518-4104-aa1e-c81df00c6255 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] HTTP exception thrown: Instance 79139e42-0238-4e80-8a53-b00cb59e03f0 could not be found. Oct 19 00:48:28.094620 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-9594c727-c518-4104-aa1e-c81df00c6255 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Request method failure captured: Oct 19 00:48:28.094620 dv-cinder-master-3-smb devstack@n-api.service[125532]: request: GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0 HTTP/1.1 Oct 19 00:48:28.094620 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept: application/json Oct 19 00:48:28.094620 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept-Encoding: identity Oct 19 00:48:28.094620 dv-cinder-master-3-smb devstack@n-api.service[125532]: Connection: close Oct 19 00:48:28.094620 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Length: 0 Oct 19 00:48:28.094620 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Type: application/json Oct 19 00:48:28.094620 dv-cinder-master-3-smb devstack@n-api.service[125532]: Host: 10.222.0.33 Oct 19 00:48:28.094620 dv-cinder-master-3-smb devstack@n-api.service[125532]: Openstack-System-Scope: None Oct 19 00:48:28.094620 dv-cinder-master-3-smb devstack@n-api.service[125532]: User-Agent: python-urllib3/1.26.12 Oct 19 00:48:28.094620 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Auth-Token: gAAAAABjT0daDvyC8O7kM1DrmURjVrB5Fw-3PywDlM59r2vWGzUCDmQgwbzwn6dqs025_y_VhaMJog77RLJ7YaOVyUqJ64pjZDiX8vT3JzGgx9ggg14vRTQE8O3CWV8o89s6z8biRF1ppb_jgvPfARfc-nlqCyah0Att6gVG_6GRDnlAyaFj9xI Oct 19 00:48:28.094620 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Id: None Oct 19 00:48:28.094620 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Name: None Oct 19 00:48:28.094620 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Identity-Status: Confirmed Oct 19 00:48:28.094620 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Is-Admin-Project: True Oct 19 00:48:28.094620 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Id: default Oct 19 00:48:28.094620 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Name: Default Oct 19 00:48:28.094620 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Id: f150d0c748e54c3eb4943b2b41adb99a Oct 19 00:48:28.094620 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Name: tempest-AttachVolumeTestJSON-1055831001 Oct 19 00:48:28.094620 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Role: member,reader Oct 19 00:48:28.094620 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Roles: member,reader Oct 19 00:48:28.096225 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f150d0c748e54c3eb4943b2b41adb99a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f150d0c748e54c3eb4943b2b41adb99a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f150d0c748e54c3eb4943b2b41adb99a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f150d0c748e54c3eb4943b2b41adb99a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:48:28.096225 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant: tempest-AttachVolumeTestJSON-1055831001 Oct 19 00:48:28.096225 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Id: f150d0c748e54c3eb4943b2b41adb99a Oct 19 00:48:28.096225 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1055831001 Oct 19 00:48:28.096225 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User: tempest-AttachVolumeTestJSON-1055831001-project Oct 19 00:48:28.096225 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Id: default Oct 19 00:48:28.096225 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Name: Default Oct 19 00:48:28.096225 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Id: aacade278860491a9eac6f86b9b2a319 Oct 19 00:48:28.096225 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Name: tempest-AttachVolumeTestJSON-1055831001-project Oct 19 00:48:28.096225 dv-cinder-master-3-smb devstack@n-api.service[125532]: method: > Oct 19 00:48:28.096225 dv-cinder-master-3-smb devstack@n-api.service[125532]: exception: Instance 79139e42-0238-4e80-8a53-b00cb59e03f0 could not be found. Oct 19 00:48:28.096225 dv-cinder-master-3-smb devstack@n-api.service[125532]: action_args: {'id': '79139e42-0238-4e80-8a53-b00cb59e03f0'} Oct 19 00:48:28.097004 dv-cinder-master-3-smb devstack@n-api.service[125532]: {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:48:28.097004 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:28.097004 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:48:28.097004 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:48:28.097004 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:48:28.097004 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:48:28.097004 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:48:28.097004 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:48:28.097004 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:48:28.097004 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:48:28.097004 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79139e42-0238-4e80-8a53-b00cb59e03f0 could not be found. Oct 19 00:48:28.097004 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:48:28.097004 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:28.097004 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:48:28.097004 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:28.097004 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:28.097004 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:28.097004 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:48:28.097004 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:48:28.097004 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:48:28.098579 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:48:28.098579 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:48:28.098579 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:48:28.098579 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:48:28.098579 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:48:28.098579 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:48:28.098579 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:48:28.098579 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79139e42-0238-4e80-8a53-b00cb59e03f0 could not be found. Oct 19 00:48:28.098579 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:48:28.098579 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:28.098579 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:48:28.098579 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:28.098579 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:28.098579 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:28.098579 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:48:28.098579 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:48:28.098579 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79139e42-0238-4e80-8a53-b00cb59e03f0 could not be found. Oct 19 00:48:28.098579 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:48:28.100042 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-9594c727-c518-4104-aa1e-c81df00c6255 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Returning 404 to user: Instance 79139e42-0238-4e80-8a53-b00cb59e03f0 could not be found. {{(pid=125532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:48:28.100042 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-9594c727-c518-4104-aa1e-c81df00c6255 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0" status: 404 len: 111 microversion: 2.1 time: 0.031604 Oct 19 00:48:28.100042 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 503/989] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:28 2022] GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:48:28.106057 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-d2b70630-5c50-42da-9c52-c756aa0cb3c4 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '.version_select at 0x7f81f120b940>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:28.124932 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-d2b70630-5c50-42da-9c52-c756aa0cb3c4 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-951521140" status: 202 len: 0 microversion: 2.1 time: 0.023425 Oct 19 00:48:28.125496 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 487/990] 10.222.0.33 () {58 vars in 1218 bytes} [Wed Oct 19 00:48:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-951521140 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:48:31.030031 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-536fcbe6-800d-402d-bcb3-ce1823ea8d2a tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:31.030565 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-536fcbe6-800d-402d-bcb3-ce1823ea8d2a tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: 79139e42-0238-4e80-8a53-b00cb59e03f0] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:31.037058 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-536fcbe6-800d-402d-bcb3-ce1823ea8d2a tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:31.037536 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-536fcbe6-800d-402d-bcb3-ce1823ea8d2a tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:31.037970 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-536fcbe6-800d-402d-bcb3-ce1823ea8d2a tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:31.038653 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-536fcbe6-800d-402d-bcb3-ce1823ea8d2a tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:31.039190 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-536fcbe6-800d-402d-bcb3-ce1823ea8d2a tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:31.039609 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-536fcbe6-800d-402d-bcb3-ce1823ea8d2a tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:31.053947 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.wsgi [None req-536fcbe6-800d-402d-bcb3-ce1823ea8d2a tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] HTTP exception thrown: Instance 79139e42-0238-4e80-8a53-b00cb59e03f0 could not be found. Oct 19 00:48:31.055473 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-536fcbe6-800d-402d-bcb3-ce1823ea8d2a tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Request method failure captured: Oct 19 00:48:31.055473 dv-cinder-master-3-smb devstack@n-api.service[125532]: request: DELETE /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0 HTTP/1.1 Oct 19 00:48:31.055473 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept: application/json Oct 19 00:48:31.055473 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept-Encoding: identity Oct 19 00:48:31.055473 dv-cinder-master-3-smb devstack@n-api.service[125532]: Connection: close Oct 19 00:48:31.055473 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Length: 0 Oct 19 00:48:31.055473 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Type: application/json Oct 19 00:48:31.055473 dv-cinder-master-3-smb devstack@n-api.service[125532]: Host: 10.222.0.33 Oct 19 00:48:31.055473 dv-cinder-master-3-smb devstack@n-api.service[125532]: Openstack-System-Scope: None Oct 19 00:48:31.055473 dv-cinder-master-3-smb devstack@n-api.service[125532]: User-Agent: python-urllib3/1.26.12 Oct 19 00:48:31.055473 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Auth-Token: gAAAAABjT0daDvyC8O7kM1DrmURjVrB5Fw-3PywDlM59r2vWGzUCDmQgwbzwn6dqs025_y_VhaMJog77RLJ7YaOVyUqJ64pjZDiX8vT3JzGgx9ggg14vRTQE8O3CWV8o89s6z8biRF1ppb_jgvPfARfc-nlqCyah0Att6gVG_6GRDnlAyaFj9xI Oct 19 00:48:31.055473 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Id: None Oct 19 00:48:31.055473 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Name: None Oct 19 00:48:31.055473 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Identity-Status: Confirmed Oct 19 00:48:31.055473 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Is-Admin-Project: True Oct 19 00:48:31.055473 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Id: default Oct 19 00:48:31.055473 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Name: Default Oct 19 00:48:31.055473 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Id: f150d0c748e54c3eb4943b2b41adb99a Oct 19 00:48:31.055473 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Name: tempest-AttachVolumeTestJSON-1055831001 Oct 19 00:48:31.055473 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Role: member,reader Oct 19 00:48:31.055473 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Roles: member,reader Oct 19 00:48:31.057291 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f150d0c748e54c3eb4943b2b41adb99a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f150d0c748e54c3eb4943b2b41adb99a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f150d0c748e54c3eb4943b2b41adb99a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f150d0c748e54c3eb4943b2b41adb99a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:48:31.057291 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant: tempest-AttachVolumeTestJSON-1055831001 Oct 19 00:48:31.057291 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Id: f150d0c748e54c3eb4943b2b41adb99a Oct 19 00:48:31.057291 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1055831001 Oct 19 00:48:31.057291 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User: tempest-AttachVolumeTestJSON-1055831001-project Oct 19 00:48:31.057291 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Id: default Oct 19 00:48:31.057291 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Name: Default Oct 19 00:48:31.057291 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Id: aacade278860491a9eac6f86b9b2a319 Oct 19 00:48:31.057291 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Name: tempest-AttachVolumeTestJSON-1055831001-project Oct 19 00:48:31.057291 dv-cinder-master-3-smb devstack@n-api.service[125532]: method: > Oct 19 00:48:31.057291 dv-cinder-master-3-smb devstack@n-api.service[125532]: exception: Instance 79139e42-0238-4e80-8a53-b00cb59e03f0 could not be found. Oct 19 00:48:31.057291 dv-cinder-master-3-smb devstack@n-api.service[125532]: action_args: {'id': '79139e42-0238-4e80-8a53-b00cb59e03f0'} Oct 19 00:48:31.058509 dv-cinder-master-3-smb devstack@n-api.service[125532]: {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:48:31.058509 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:31.058509 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:48:31.058509 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:48:31.058509 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:48:31.058509 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:48:31.058509 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:48:31.058509 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:48:31.058509 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:48:31.058509 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:48:31.058509 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79139e42-0238-4e80-8a53-b00cb59e03f0 could not be found. Oct 19 00:48:31.058509 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:48:31.058509 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:31.058509 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:48:31.058509 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:31.058509 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:31.058509 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:31.058509 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:48:31.058509 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:48:31.058509 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:48:31.060137 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:48:31.060137 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 00:48:31.060137 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 00:48:31.060137 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 00:48:31.060137 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 00:48:31.060137 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:48:31.060137 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:48:31.060137 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:48:31.060137 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:48:31.060137 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79139e42-0238-4e80-8a53-b00cb59e03f0 could not be found. Oct 19 00:48:31.060137 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:48:31.060137 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:31.060137 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:48:31.060137 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:31.060137 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:31.060137 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:31.060137 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:48:31.060137 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:48:31.060137 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79139e42-0238-4e80-8a53-b00cb59e03f0 could not be found. Oct 19 00:48:31.060137 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:48:31.061876 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-536fcbe6-800d-402d-bcb3-ce1823ea8d2a tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Returning 404 to user: Instance 79139e42-0238-4e80-8a53-b00cb59e03f0 could not be found. {{(pid=125532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:48:31.061876 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-536fcbe6-800d-402d-bcb3-ce1823ea8d2a tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "DELETE /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0" status: 404 len: 111 microversion: 2.1 time: 0.031648 Oct 19 00:48:31.061876 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 504/991] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Oct 19 00:48:31 2022] DELETE /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:48:31.066055 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-dc57eb37-7fb2-4773-9ceb-a7648101c18a tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:31.066708 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-dc57eb37-7fb2-4773-9ceb-a7648101c18a tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: 79139e42-0238-4e80-8a53-b00cb59e03f0] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:31.073492 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dc57eb37-7fb2-4773-9ceb-a7648101c18a tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:31.073980 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dc57eb37-7fb2-4773-9ceb-a7648101c18a tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:31.074419 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dc57eb37-7fb2-4773-9ceb-a7648101c18a tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:31.075108 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dc57eb37-7fb2-4773-9ceb-a7648101c18a tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:31.075566 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dc57eb37-7fb2-4773-9ceb-a7648101c18a tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:31.076023 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dc57eb37-7fb2-4773-9ceb-a7648101c18a tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:31.089442 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.wsgi [None req-dc57eb37-7fb2-4773-9ceb-a7648101c18a tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] HTTP exception thrown: Instance 79139e42-0238-4e80-8a53-b00cb59e03f0 could not be found. Oct 19 00:48:31.091203 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-dc57eb37-7fb2-4773-9ceb-a7648101c18a tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Request method failure captured: Oct 19 00:48:31.091203 dv-cinder-master-3-smb devstack@n-api.service[125531]: request: GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0 HTTP/1.1 Oct 19 00:48:31.091203 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept: application/json Oct 19 00:48:31.091203 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept-Encoding: identity Oct 19 00:48:31.091203 dv-cinder-master-3-smb devstack@n-api.service[125531]: Connection: close Oct 19 00:48:31.091203 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Length: 0 Oct 19 00:48:31.091203 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Type: application/json Oct 19 00:48:31.091203 dv-cinder-master-3-smb devstack@n-api.service[125531]: Host: 10.222.0.33 Oct 19 00:48:31.091203 dv-cinder-master-3-smb devstack@n-api.service[125531]: Openstack-System-Scope: None Oct 19 00:48:31.091203 dv-cinder-master-3-smb devstack@n-api.service[125531]: User-Agent: python-urllib3/1.26.12 Oct 19 00:48:31.091203 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Auth-Token: gAAAAABjT0daDvyC8O7kM1DrmURjVrB5Fw-3PywDlM59r2vWGzUCDmQgwbzwn6dqs025_y_VhaMJog77RLJ7YaOVyUqJ64pjZDiX8vT3JzGgx9ggg14vRTQE8O3CWV8o89s6z8biRF1ppb_jgvPfARfc-nlqCyah0Att6gVG_6GRDnlAyaFj9xI Oct 19 00:48:31.091203 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Id: None Oct 19 00:48:31.091203 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Name: None Oct 19 00:48:31.091203 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Identity-Status: Confirmed Oct 19 00:48:31.091203 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Is-Admin-Project: True Oct 19 00:48:31.091203 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Id: default Oct 19 00:48:31.091203 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Name: Default Oct 19 00:48:31.091203 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Id: f150d0c748e54c3eb4943b2b41adb99a Oct 19 00:48:31.091203 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Name: tempest-AttachVolumeTestJSON-1055831001 Oct 19 00:48:31.091203 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Role: member,reader Oct 19 00:48:31.091203 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Roles: member,reader Oct 19 00:48:31.092834 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f150d0c748e54c3eb4943b2b41adb99a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f150d0c748e54c3eb4943b2b41adb99a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f150d0c748e54c3eb4943b2b41adb99a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f150d0c748e54c3eb4943b2b41adb99a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:48:31.092834 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant: tempest-AttachVolumeTestJSON-1055831001 Oct 19 00:48:31.092834 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Id: f150d0c748e54c3eb4943b2b41adb99a Oct 19 00:48:31.092834 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1055831001 Oct 19 00:48:31.092834 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User: tempest-AttachVolumeTestJSON-1055831001-project Oct 19 00:48:31.092834 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Id: default Oct 19 00:48:31.092834 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Name: Default Oct 19 00:48:31.092834 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Id: aacade278860491a9eac6f86b9b2a319 Oct 19 00:48:31.092834 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Name: tempest-AttachVolumeTestJSON-1055831001-project Oct 19 00:48:31.092834 dv-cinder-master-3-smb devstack@n-api.service[125531]: method: > Oct 19 00:48:31.092834 dv-cinder-master-3-smb devstack@n-api.service[125531]: exception: Instance 79139e42-0238-4e80-8a53-b00cb59e03f0 could not be found. Oct 19 00:48:31.092834 dv-cinder-master-3-smb devstack@n-api.service[125531]: action_args: {'id': '79139e42-0238-4e80-8a53-b00cb59e03f0'} Oct 19 00:48:31.093831 dv-cinder-master-3-smb devstack@n-api.service[125531]: {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:48:31.093831 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:31.093831 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:48:31.093831 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:48:31.093831 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:48:31.093831 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:48:31.093831 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:48:31.093831 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:48:31.093831 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:48:31.093831 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:48:31.093831 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79139e42-0238-4e80-8a53-b00cb59e03f0 could not be found. Oct 19 00:48:31.093831 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:48:31.093831 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:31.093831 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:48:31.093831 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:31.093831 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:31.093831 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:31.093831 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:48:31.093831 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:48:31.093831 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:48:31.095334 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:48:31.095334 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:48:31.095334 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:48:31.095334 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:48:31.095334 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:48:31.095334 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:48:31.095334 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:48:31.095334 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79139e42-0238-4e80-8a53-b00cb59e03f0 could not be found. Oct 19 00:48:31.095334 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:48:31.095334 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:31.095334 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:48:31.095334 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:31.095334 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:31.095334 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:31.095334 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:48:31.095334 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:48:31.095334 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79139e42-0238-4e80-8a53-b00cb59e03f0 could not be found. Oct 19 00:48:31.095334 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:48:31.096893 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-dc57eb37-7fb2-4773-9ceb-a7648101c18a tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Returning 404 to user: Instance 79139e42-0238-4e80-8a53-b00cb59e03f0 could not be found. {{(pid=125531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:48:31.096893 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-dc57eb37-7fb2-4773-9ceb-a7648101c18a tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0" status: 404 len: 111 microversion: 2.1 time: 0.031037 Oct 19 00:48:31.096893 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 488/992] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:31 2022] GET /compute/v2.1/servers/79139e42-0238-4e80-8a53-b00cb59e03f0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:48:32.230370 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-2e4c3162-a2e8-4b8f-9b66-79bb5f0568f8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:32.230863 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-2e4c3162-a2e8-4b8f-9b66-79bb5f0568f8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:32.237236 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2e4c3162-a2e8-4b8f-9b66-79bb5f0568f8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:32.237724 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2e4c3162-a2e8-4b8f-9b66-79bb5f0568f8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:32.238159 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2e4c3162-a2e8-4b8f-9b66-79bb5f0568f8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:32.238858 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2e4c3162-a2e8-4b8f-9b66-79bb5f0568f8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:32.239318 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2e4c3162-a2e8-4b8f-9b66-79bb5f0568f8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:32.239748 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2e4c3162-a2e8-4b8f-9b66-79bb5f0568f8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:32.253850 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.wsgi [None req-2e4c3162-a2e8-4b8f-9b66-79bb5f0568f8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] HTTP exception thrown: Instance f550e071-b7cd-4628-aff9-59e09cfcd654 could not be found. Oct 19 00:48:32.255382 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-2e4c3162-a2e8-4b8f-9b66-79bb5f0568f8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Request method failure captured: Oct 19 00:48:32.255382 dv-cinder-master-3-smb devstack@n-api.service[125532]: request: DELETE /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 HTTP/1.1 Oct 19 00:48:32.255382 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept: application/json Oct 19 00:48:32.255382 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept-Encoding: identity Oct 19 00:48:32.255382 dv-cinder-master-3-smb devstack@n-api.service[125532]: Connection: close Oct 19 00:48:32.255382 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Length: 0 Oct 19 00:48:32.255382 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Type: application/json Oct 19 00:48:32.255382 dv-cinder-master-3-smb devstack@n-api.service[125532]: Host: 10.222.0.33 Oct 19 00:48:32.255382 dv-cinder-master-3-smb devstack@n-api.service[125532]: Openstack-System-Scope: None Oct 19 00:48:32.255382 dv-cinder-master-3-smb devstack@n-api.service[125532]: User-Agent: python-urllib3/1.26.12 Oct 19 00:48:32.255382 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Auth-Token: gAAAAABjT0daDvyC8O7kM1DrmURjVrB5Fw-3PywDlM59r2vWGzUCDmQgwbzwn6dqs025_y_VhaMJog77RLJ7YaOVyUqJ64pjZDiX8vT3JzGgx9ggg14vRTQE8O3CWV8o89s6z8biRF1ppb_jgvPfARfc-nlqCyah0Att6gVG_6GRDnlAyaFj9xI Oct 19 00:48:32.255382 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Id: None Oct 19 00:48:32.255382 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Name: None Oct 19 00:48:32.255382 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Identity-Status: Confirmed Oct 19 00:48:32.255382 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Is-Admin-Project: True Oct 19 00:48:32.255382 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Id: default Oct 19 00:48:32.255382 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Name: Default Oct 19 00:48:32.255382 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Id: f150d0c748e54c3eb4943b2b41adb99a Oct 19 00:48:32.255382 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Name: tempest-AttachVolumeTestJSON-1055831001 Oct 19 00:48:32.255382 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Role: member,reader Oct 19 00:48:32.255382 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Roles: member,reader Oct 19 00:48:32.257032 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f150d0c748e54c3eb4943b2b41adb99a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f150d0c748e54c3eb4943b2b41adb99a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f150d0c748e54c3eb4943b2b41adb99a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f150d0c748e54c3eb4943b2b41adb99a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:48:32.257032 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant: tempest-AttachVolumeTestJSON-1055831001 Oct 19 00:48:32.257032 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Id: f150d0c748e54c3eb4943b2b41adb99a Oct 19 00:48:32.257032 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1055831001 Oct 19 00:48:32.257032 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User: tempest-AttachVolumeTestJSON-1055831001-project Oct 19 00:48:32.257032 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Id: default Oct 19 00:48:32.257032 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Name: Default Oct 19 00:48:32.257032 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Id: aacade278860491a9eac6f86b9b2a319 Oct 19 00:48:32.257032 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Name: tempest-AttachVolumeTestJSON-1055831001-project Oct 19 00:48:32.257032 dv-cinder-master-3-smb devstack@n-api.service[125532]: method: > Oct 19 00:48:32.257032 dv-cinder-master-3-smb devstack@n-api.service[125532]: exception: Instance f550e071-b7cd-4628-aff9-59e09cfcd654 could not be found. Oct 19 00:48:32.257032 dv-cinder-master-3-smb devstack@n-api.service[125532]: action_args: {'id': 'f550e071-b7cd-4628-aff9-59e09cfcd654'} Oct 19 00:48:32.258666 dv-cinder-master-3-smb devstack@n-api.service[125532]: {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:48:32.258666 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:32.258666 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:48:32.258666 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:48:32.258666 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:48:32.258666 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:48:32.258666 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:48:32.258666 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:48:32.258666 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:48:32.258666 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:48:32.258666 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f550e071-b7cd-4628-aff9-59e09cfcd654 could not be found. Oct 19 00:48:32.258666 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:48:32.258666 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:32.258666 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:48:32.258666 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:32.258666 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:32.258666 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:32.258666 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:48:32.258666 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:48:32.258666 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:48:32.260282 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:48:32.260282 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 00:48:32.260282 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 00:48:32.260282 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 00:48:32.260282 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 00:48:32.260282 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:48:32.260282 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:48:32.260282 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:48:32.260282 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:48:32.260282 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f550e071-b7cd-4628-aff9-59e09cfcd654 could not be found. Oct 19 00:48:32.260282 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:48:32.260282 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:32.260282 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:48:32.260282 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:32.260282 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:32.260282 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:32.260282 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:48:32.260282 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:48:32.260282 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f550e071-b7cd-4628-aff9-59e09cfcd654 could not be found. Oct 19 00:48:32.260282 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:48:32.261869 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-2e4c3162-a2e8-4b8f-9b66-79bb5f0568f8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Returning 404 to user: Instance f550e071-b7cd-4628-aff9-59e09cfcd654 could not be found. {{(pid=125532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:48:32.261869 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-2e4c3162-a2e8-4b8f-9b66-79bb5f0568f8 tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 404 len: 111 microversion: 2.1 time: 0.030936 Oct 19 00:48:32.261869 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 505/993] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Oct 19 00:48:32 2022] DELETE /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:48:32.265330 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-a270ba76-3e76-4dda-be27-9936c12094de tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:32.265951 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-a270ba76-3e76-4dda-be27-9936c12094de tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] [instance: f550e071-b7cd-4628-aff9-59e09cfcd654] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:32.272572 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a270ba76-3e76-4dda-be27-9936c12094de tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:32.273056 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a270ba76-3e76-4dda-be27-9936c12094de tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:32.273502 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a270ba76-3e76-4dda-be27-9936c12094de tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:32.274192 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a270ba76-3e76-4dda-be27-9936c12094de tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:32.274647 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a270ba76-3e76-4dda-be27-9936c12094de tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:32.275071 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-a270ba76-3e76-4dda-be27-9936c12094de tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:32.290918 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.wsgi [None req-a270ba76-3e76-4dda-be27-9936c12094de tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] HTTP exception thrown: Instance f550e071-b7cd-4628-aff9-59e09cfcd654 could not be found. Oct 19 00:48:32.293102 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-a270ba76-3e76-4dda-be27-9936c12094de tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Request method failure captured: Oct 19 00:48:32.293102 dv-cinder-master-3-smb devstack@n-api.service[125531]: request: GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 HTTP/1.1 Oct 19 00:48:32.293102 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept: application/json Oct 19 00:48:32.293102 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept-Encoding: identity Oct 19 00:48:32.293102 dv-cinder-master-3-smb devstack@n-api.service[125531]: Connection: close Oct 19 00:48:32.293102 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Length: 0 Oct 19 00:48:32.293102 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Type: application/json Oct 19 00:48:32.293102 dv-cinder-master-3-smb devstack@n-api.service[125531]: Host: 10.222.0.33 Oct 19 00:48:32.293102 dv-cinder-master-3-smb devstack@n-api.service[125531]: Openstack-System-Scope: None Oct 19 00:48:32.293102 dv-cinder-master-3-smb devstack@n-api.service[125531]: User-Agent: python-urllib3/1.26.12 Oct 19 00:48:32.293102 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Auth-Token: gAAAAABjT0daDvyC8O7kM1DrmURjVrB5Fw-3PywDlM59r2vWGzUCDmQgwbzwn6dqs025_y_VhaMJog77RLJ7YaOVyUqJ64pjZDiX8vT3JzGgx9ggg14vRTQE8O3CWV8o89s6z8biRF1ppb_jgvPfARfc-nlqCyah0Att6gVG_6GRDnlAyaFj9xI Oct 19 00:48:32.293102 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Id: None Oct 19 00:48:32.293102 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Name: None Oct 19 00:48:32.293102 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Identity-Status: Confirmed Oct 19 00:48:32.293102 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Is-Admin-Project: True Oct 19 00:48:32.293102 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Id: default Oct 19 00:48:32.293102 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Name: Default Oct 19 00:48:32.293102 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Id: f150d0c748e54c3eb4943b2b41adb99a Oct 19 00:48:32.293102 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Name: tempest-AttachVolumeTestJSON-1055831001 Oct 19 00:48:32.293102 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Role: member,reader Oct 19 00:48:32.293102 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Roles: member,reader Oct 19 00:48:32.294703 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f150d0c748e54c3eb4943b2b41adb99a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f150d0c748e54c3eb4943b2b41adb99a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f150d0c748e54c3eb4943b2b41adb99a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f150d0c748e54c3eb4943b2b41adb99a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:48:32.294703 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant: tempest-AttachVolumeTestJSON-1055831001 Oct 19 00:48:32.294703 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Id: f150d0c748e54c3eb4943b2b41adb99a Oct 19 00:48:32.294703 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1055831001 Oct 19 00:48:32.294703 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User: tempest-AttachVolumeTestJSON-1055831001-project Oct 19 00:48:32.294703 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Id: default Oct 19 00:48:32.294703 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Name: Default Oct 19 00:48:32.294703 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Id: aacade278860491a9eac6f86b9b2a319 Oct 19 00:48:32.294703 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Name: tempest-AttachVolumeTestJSON-1055831001-project Oct 19 00:48:32.294703 dv-cinder-master-3-smb devstack@n-api.service[125531]: method: > Oct 19 00:48:32.294703 dv-cinder-master-3-smb devstack@n-api.service[125531]: exception: Instance f550e071-b7cd-4628-aff9-59e09cfcd654 could not be found. Oct 19 00:48:32.294703 dv-cinder-master-3-smb devstack@n-api.service[125531]: action_args: {'id': 'f550e071-b7cd-4628-aff9-59e09cfcd654'} Oct 19 00:48:32.295581 dv-cinder-master-3-smb devstack@n-api.service[125531]: {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:48:32.295581 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:32.295581 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:48:32.295581 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:48:32.295581 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:48:32.295581 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:48:32.295581 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:48:32.295581 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:48:32.295581 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:48:32.295581 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:48:32.295581 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f550e071-b7cd-4628-aff9-59e09cfcd654 could not be found. Oct 19 00:48:32.295581 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:48:32.295581 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:32.295581 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:48:32.295581 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:32.295581 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:32.295581 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:32.295581 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:48:32.295581 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:48:32.295581 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:48:32.297257 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:48:32.297257 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:48:32.297257 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:48:32.297257 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:48:32.297257 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:48:32.297257 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:48:32.297257 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:48:32.297257 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f550e071-b7cd-4628-aff9-59e09cfcd654 could not be found. Oct 19 00:48:32.297257 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:48:32.297257 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:32.297257 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:48:32.297257 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:32.297257 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:32.297257 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:32.297257 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:48:32.297257 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:48:32.297257 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f550e071-b7cd-4628-aff9-59e09cfcd654 could not be found. Oct 19 00:48:32.297257 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:48:32.298739 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-a270ba76-3e76-4dda-be27-9936c12094de tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] Returning 404 to user: Instance f550e071-b7cd-4628-aff9-59e09cfcd654 could not be found. {{(pid=125531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:48:32.298739 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-a270ba76-3e76-4dda-be27-9936c12094de tempest-AttachVolumeTestJSON-1055831001 tempest-AttachVolumeTestJSON-1055831001-project] 10.222.0.33 "GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654" status: 404 len: 111 microversion: 2.1 time: 0.033015 Oct 19 00:48:32.298739 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 489/994] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:32 2022] GET /compute/v2.1/servers/f550e071-b7cd-4628-aff9-59e09cfcd654 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:48:37.831328 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-6f99320c-3c68-4b05-9e2f-399c2d32d811 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:37.831983 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-6f99320c-3c68-4b05-9e2f-399c2d32d811 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:37.839465 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6f99320c-3c68-4b05-9e2f-399c2d32d811 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:37.840263 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6f99320c-3c68-4b05-9e2f-399c2d32d811 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:37.840704 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6f99320c-3c68-4b05-9e2f-399c2d32d811 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:37.841408 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6f99320c-3c68-4b05-9e2f-399c2d32d811 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:37.841868 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6f99320c-3c68-4b05-9e2f-399c2d32d811 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:37.842297 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6f99320c-3c68-4b05-9e2f-399c2d32d811 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:37.865988 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.objects.instance [None req-6f99320c-3c68-4b05-9e2f-399c2d32d811 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lazy-loading 'flavor' on Instance uuid 6a4f60d9-b884-40cb-a416-b34e456f77e9 {{(pid=125532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:48:37.940861 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-6f99320c-3c68-4b05-9e2f-399c2d32d811 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "POST /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9/action" status: 202 len: 0 microversion: 2.1 time: 0.113159 Oct 19 00:48:37.944903 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 506/995] 10.222.0.33 () {60 vars in 1278 bytes} [Wed Oct 19 00:48:37 2022] POST /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:48:37.954079 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-7f80ff2b-4e86-4aae-a0f0-0addfaec43c5 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:37.954870 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-7f80ff2b-4e86-4aae-a0f0-0addfaec43c5 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:37.962333 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7f80ff2b-4e86-4aae-a0f0-0addfaec43c5 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:37.962843 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7f80ff2b-4e86-4aae-a0f0-0addfaec43c5 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:37.964479 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7f80ff2b-4e86-4aae-a0f0-0addfaec43c5 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:37.965213 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7f80ff2b-4e86-4aae-a0f0-0addfaec43c5 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:37.965666 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7f80ff2b-4e86-4aae-a0f0-0addfaec43c5 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:37.966370 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7f80ff2b-4e86-4aae-a0f0-0addfaec43c5 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:37.969397 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:38.135605 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-7f80ff2b-4e86-4aae-a0f0-0addfaec43c5 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:38.143964 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-7f80ff2b-4e86-4aae-a0f0-0addfaec43c5 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1567 microversion: 2.1 time: 0.197262 Oct 19 00:48:38.144591 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 490/996] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:37 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1567 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:39.170000 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-f38adfd2-725b-4776-8c99-60b7c523a085 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:39.170712 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-f38adfd2-725b-4776-8c99-60b7c523a085 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:39.176903 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f38adfd2-725b-4776-8c99-60b7c523a085 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:39.177393 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f38adfd2-725b-4776-8c99-60b7c523a085 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:39.177830 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f38adfd2-725b-4776-8c99-60b7c523a085 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:39.178525 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f38adfd2-725b-4776-8c99-60b7c523a085 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:39.178984 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f38adfd2-725b-4776-8c99-60b7c523a085 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:39.179409 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f38adfd2-725b-4776-8c99-60b7c523a085 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:39.314170 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-f38adfd2-725b-4776-8c99-60b7c523a085 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:39.322637 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-f38adfd2-725b-4776-8c99-60b7c523a085 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1567 microversion: 2.1 time: 0.158051 Oct 19 00:48:39.323314 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 507/997] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:39 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:40.347064 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-4ac912b2-2784-4501-996f-e3cda02c8248 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:40.347821 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-4ac912b2-2784-4501-996f-e3cda02c8248 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:40.354249 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4ac912b2-2784-4501-996f-e3cda02c8248 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:40.354835 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4ac912b2-2784-4501-996f-e3cda02c8248 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:40.355489 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4ac912b2-2784-4501-996f-e3cda02c8248 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:40.356365 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4ac912b2-2784-4501-996f-e3cda02c8248 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:40.356918 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4ac912b2-2784-4501-996f-e3cda02c8248 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:40.357408 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4ac912b2-2784-4501-996f-e3cda02c8248 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:40.503790 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-4ac912b2-2784-4501-996f-e3cda02c8248 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:40.513992 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-4ac912b2-2784-4501-996f-e3cda02c8248 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1567 microversion: 2.1 time: 0.171872 Oct 19 00:48:40.514589 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 491/998] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:40 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:41.538048 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-018ace1c-6ab0-41db-bfac-65986801ef30 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:41.538694 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-018ace1c-6ab0-41db-bfac-65986801ef30 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:41.546112 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-018ace1c-6ab0-41db-bfac-65986801ef30 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:41.546749 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-018ace1c-6ab0-41db-bfac-65986801ef30 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:41.547085 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-018ace1c-6ab0-41db-bfac-65986801ef30 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:41.547833 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-018ace1c-6ab0-41db-bfac-65986801ef30 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:41.548302 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-018ace1c-6ab0-41db-bfac-65986801ef30 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:41.548725 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-018ace1c-6ab0-41db-bfac-65986801ef30 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:41.696363 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-018ace1c-6ab0-41db-bfac-65986801ef30 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:41.715153 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-018ace1c-6ab0-41db-bfac-65986801ef30 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1567 microversion: 2.1 time: 0.173629 Oct 19 00:48:41.715153 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 508/999] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:41 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:42.731374 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-526641d1-035c-4c61-b504-c75ef557023e tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:42.732012 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-526641d1-035c-4c61-b504-c75ef557023e tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:42.738661 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-526641d1-035c-4c61-b504-c75ef557023e tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:42.739169 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-526641d1-035c-4c61-b504-c75ef557023e tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:42.739601 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-526641d1-035c-4c61-b504-c75ef557023e tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:42.740327 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-526641d1-035c-4c61-b504-c75ef557023e tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:42.740816 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-526641d1-035c-4c61-b504-c75ef557023e tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:42.741239 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-526641d1-035c-4c61-b504-c75ef557023e tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:42.875930 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-526641d1-035c-4c61-b504-c75ef557023e tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:42.883694 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-526641d1-035c-4c61-b504-c75ef557023e tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1567 microversion: 2.1 time: 0.156591 Oct 19 00:48:42.889096 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 492/1000] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:42 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:42.927630 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-0fde7222-ef8b-4562-8ba9-7d6ad70ea571 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:42.928334 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-0fde7222-ef8b-4562-8ba9-7d6ad70ea571 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: a47e01df-7873-48e6-9df8-6bcf54a0f468] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:42.935930 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0fde7222-ef8b-4562-8ba9-7d6ad70ea571 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:42.936555 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0fde7222-ef8b-4562-8ba9-7d6ad70ea571 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:42.937051 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0fde7222-ef8b-4562-8ba9-7d6ad70ea571 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:42.937812 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0fde7222-ef8b-4562-8ba9-7d6ad70ea571 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:42.938437 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0fde7222-ef8b-4562-8ba9-7d6ad70ea571 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:42.938780 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0fde7222-ef8b-4562-8ba9-7d6ad70ea571 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:42.965097 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-0fde7222-ef8b-4562-8ba9-7d6ad70ea571 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468/ips" status: 200 len: 149 microversion: 2.1 time: 0.041378 Oct 19 00:48:42.965677 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 509/1001] 10.222.0.33 () {58 vars in 1248 bytes} [Wed Oct 19 00:48:42 2022] GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:43.906962 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-cd332df4-bb16-4695-a1e6-1d00ed5731f7 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:43.907715 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-cd332df4-bb16-4695-a1e6-1d00ed5731f7 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:43.914085 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cd332df4-bb16-4695-a1e6-1d00ed5731f7 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:43.914562 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cd332df4-bb16-4695-a1e6-1d00ed5731f7 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:43.914994 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cd332df4-bb16-4695-a1e6-1d00ed5731f7 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:43.915677 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cd332df4-bb16-4695-a1e6-1d00ed5731f7 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:43.916155 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cd332df4-bb16-4695-a1e6-1d00ed5731f7 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:43.917099 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-cd332df4-bb16-4695-a1e6-1d00ed5731f7 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:44.059682 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-cd332df4-bb16-4695-a1e6-1d00ed5731f7 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:44.067505 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-cd332df4-bb16-4695-a1e6-1d00ed5731f7 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1567 microversion: 2.1 time: 0.164510 Oct 19 00:48:44.068076 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 493/1002] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:43 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:44.332998 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-0c9ba8ab-ab13-4f8b-8283-2a5c328d49fb tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "487cbe50-0c90-4880-b94f-385d36064f15"}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:44.335535 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-0c9ba8ab-ab13-4f8b-8283-2a5c328d49fb tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: a47e01df-7873-48e6-9df8-6bcf54a0f468] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:44.342852 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0c9ba8ab-ab13-4f8b-8283-2a5c328d49fb tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:44.343334 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0c9ba8ab-ab13-4f8b-8283-2a5c328d49fb tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:44.343819 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0c9ba8ab-ab13-4f8b-8283-2a5c328d49fb tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:44.344535 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0c9ba8ab-ab13-4f8b-8283-2a5c328d49fb tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:44.344982 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0c9ba8ab-ab13-4f8b-8283-2a5c328d49fb tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:44.345401 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0c9ba8ab-ab13-4f8b-8283-2a5c328d49fb tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:44.616687 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-0c9ba8ab-ab13-4f8b-8283-2a5c328d49fb tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "POST /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287570 Oct 19 00:48:44.623538 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 510/1003] 10.222.0.33 () {60 vars in 1323 bytes} [Wed Oct 19 00:48:44 2022] POST /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:45.091481 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-344e8ab7-2ae6-42be-917d-f86a30d3d46e tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:45.092120 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-344e8ab7-2ae6-42be-917d-f86a30d3d46e tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:45.098464 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-344e8ab7-2ae6-42be-917d-f86a30d3d46e tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:45.098940 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-344e8ab7-2ae6-42be-917d-f86a30d3d46e tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:45.099371 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-344e8ab7-2ae6-42be-917d-f86a30d3d46e tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:45.100084 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-344e8ab7-2ae6-42be-917d-f86a30d3d46e tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:45.100536 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-344e8ab7-2ae6-42be-917d-f86a30d3d46e tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:45.100951 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-344e8ab7-2ae6-42be-917d-f86a30d3d46e tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:45.232295 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-344e8ab7-2ae6-42be-917d-f86a30d3d46e tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:45.239948 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-344e8ab7-2ae6-42be-917d-f86a30d3d46e tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1567 microversion: 2.1 time: 0.153378 Oct 19 00:48:45.240506 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 494/1004] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:45 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:46.263880 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-6f2804c6-b39b-499e-9103-7b8e6ab13a4d tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:46.264507 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-6f2804c6-b39b-499e-9103-7b8e6ab13a4d tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:46.270742 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6f2804c6-b39b-499e-9103-7b8e6ab13a4d tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:46.271231 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6f2804c6-b39b-499e-9103-7b8e6ab13a4d tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:46.271691 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6f2804c6-b39b-499e-9103-7b8e6ab13a4d tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:46.272395 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6f2804c6-b39b-499e-9103-7b8e6ab13a4d tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:46.272852 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6f2804c6-b39b-499e-9103-7b8e6ab13a4d tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:46.273278 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-6f2804c6-b39b-499e-9103-7b8e6ab13a4d tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:46.403024 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-6f2804c6-b39b-499e-9103-7b8e6ab13a4d tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:46.405410 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:46.412132 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-6f2804c6-b39b-499e-9103-7b8e6ab13a4d tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1567 microversion: 2.1 time: 0.153042 Oct 19 00:48:46.412698 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 511/1005] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:46 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:46.973604 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-d30271ec-183f-4ee7-a7db-8d69c8ece512 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:46.974159 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-d30271ec-183f-4ee7-a7db-8d69c8ece512 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: a47e01df-7873-48e6-9df8-6bcf54a0f468] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:46.980850 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d30271ec-183f-4ee7-a7db-8d69c8ece512 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:46.981331 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d30271ec-183f-4ee7-a7db-8d69c8ece512 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:46.981795 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d30271ec-183f-4ee7-a7db-8d69c8ece512 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:46.982488 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d30271ec-183f-4ee7-a7db-8d69c8ece512 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:46.982940 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d30271ec-183f-4ee7-a7db-8d69c8ece512 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:46.983362 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d30271ec-183f-4ee7-a7db-8d69c8ece512 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:47.067356 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.objects.instance [None req-d30271ec-183f-4ee7-a7db-8d69c8ece512 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lazy-loading 'services' on Instance uuid a47e01df-7873-48e6-9df8-6bcf54a0f468 {{(pid=125531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:48:47.149824 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-d30271ec-183f-4ee7-a7db-8d69c8ece512 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468/os-volume_attachments/487cbe50-0c90-4880-b94f-385d36064f15" status: 202 len: 0 microversion: 2.1 time: 0.180254 Oct 19 00:48:47.150506 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 495/1006] 10.222.0.33 () {58 vars in 1416 bytes} [Wed Oct 19 00:48:46 2022] DELETE /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468/os-volume_attachments/487cbe50-0c90-4880-b94f-385d36064f15 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:48:47.160235 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-23e0bc13-f7f9-40a2-a6b1-39440c7529ce tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:47.162477 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-23e0bc13-f7f9-40a2-a6b1-39440c7529ce tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: a47e01df-7873-48e6-9df8-6bcf54a0f468] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:47.170305 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-23e0bc13-f7f9-40a2-a6b1-39440c7529ce tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:47.170764 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-23e0bc13-f7f9-40a2-a6b1-39440c7529ce tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:47.171390 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-23e0bc13-f7f9-40a2-a6b1-39440c7529ce tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:47.172027 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-23e0bc13-f7f9-40a2-a6b1-39440c7529ce tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:47.172527 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-23e0bc13-f7f9-40a2-a6b1-39440c7529ce tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:47.172943 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-23e0bc13-f7f9-40a2-a6b1-39440c7529ce tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:47.204436 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-23e0bc13-f7f9-40a2-a6b1-39440c7529ce tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048484 Oct 19 00:48:47.205003 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 512/1007] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Oct 19 00:48:47 2022] GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:47.436274 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-23b5ad8b-c7b1-4e23-9c2c-63c1ad06c407 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:47.436913 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-23b5ad8b-c7b1-4e23-9c2c-63c1ad06c407 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:47.443000 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-23b5ad8b-c7b1-4e23-9c2c-63c1ad06c407 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:47.443481 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-23b5ad8b-c7b1-4e23-9c2c-63c1ad06c407 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:47.443950 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-23b5ad8b-c7b1-4e23-9c2c-63c1ad06c407 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:47.444637 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-23b5ad8b-c7b1-4e23-9c2c-63c1ad06c407 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:47.445088 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-23b5ad8b-c7b1-4e23-9c2c-63c1ad06c407 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:47.445508 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-23b5ad8b-c7b1-4e23-9c2c-63c1ad06c407 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:47.575173 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-23b5ad8b-c7b1-4e23-9c2c-63c1ad06c407 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:47.582842 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-23b5ad8b-c7b1-4e23-9c2c-63c1ad06c407 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1567 microversion: 2.1 time: 0.151670 Oct 19 00:48:47.583404 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 496/1008] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:47 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:48.217760 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-af7e3ade-15d0-4218-a400-30b72cd70ec6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:48.219942 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-af7e3ade-15d0-4218-a400-30b72cd70ec6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: a47e01df-7873-48e6-9df8-6bcf54a0f468] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:48.226423 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-af7e3ade-15d0-4218-a400-30b72cd70ec6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:48.226905 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-af7e3ade-15d0-4218-a400-30b72cd70ec6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:48.227341 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-af7e3ade-15d0-4218-a400-30b72cd70ec6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:48.228076 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-af7e3ade-15d0-4218-a400-30b72cd70ec6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:48.228531 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-af7e3ade-15d0-4218-a400-30b72cd70ec6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:48.228953 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-af7e3ade-15d0-4218-a400-30b72cd70ec6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:48.259517 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-af7e3ade-15d0-4218-a400-30b72cd70ec6 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046142 Oct 19 00:48:48.260222 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 513/1009] 10.222.0.33 () {58 vars in 1302 bytes} [Wed Oct 19 00:48:48 2022] GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:48:48.326758 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-2cd7b967-4bd6-4393-a306-9fa004eebfc1 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:48.327302 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-2cd7b967-4bd6-4393-a306-9fa004eebfc1 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: a47e01df-7873-48e6-9df8-6bcf54a0f468] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:48.333928 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2cd7b967-4bd6-4393-a306-9fa004eebfc1 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:48.334724 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2cd7b967-4bd6-4393-a306-9fa004eebfc1 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:48.335379 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2cd7b967-4bd6-4393-a306-9fa004eebfc1 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:48.335967 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2cd7b967-4bd6-4393-a306-9fa004eebfc1 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:48.336429 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2cd7b967-4bd6-4393-a306-9fa004eebfc1 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:48.336853 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2cd7b967-4bd6-4393-a306-9fa004eebfc1 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:48.364059 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-2cd7b967-4bd6-4393-a306-9fa004eebfc1 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: a47e01df-7873-48e6-9df8-6bcf54a0f468] Going to try to terminate instance {{(pid=125531) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:48:48.443470 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-2cd7b967-4bd6-4393-a306-9fa004eebfc1 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468" status: 204 len: 0 microversion: 2.1 time: 0.120700 Oct 19 00:48:48.444293 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 497/1010] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Oct 19 00:48:48 2022] DELETE /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:48:48.452973 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-7a4ec596-3f4b-4434-822c-fa1e47d0f1de tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:48.453570 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-7a4ec596-3f4b-4434-822c-fa1e47d0f1de tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: a47e01df-7873-48e6-9df8-6bcf54a0f468] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:48.459444 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7a4ec596-3f4b-4434-822c-fa1e47d0f1de tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:48.459962 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7a4ec596-3f4b-4434-822c-fa1e47d0f1de tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:48.460401 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7a4ec596-3f4b-4434-822c-fa1e47d0f1de tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:48.461087 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7a4ec596-3f4b-4434-822c-fa1e47d0f1de tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:48.461541 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7a4ec596-3f4b-4434-822c-fa1e47d0f1de tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:48.461965 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7a4ec596-3f4b-4434-822c-fa1e47d0f1de tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:48.609076 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-50f4d375-5dd8-4e77-887c-7263741d2456 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:48.609881 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-7a4ec596-3f4b-4434-822c-fa1e47d0f1de tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:48.610434 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-50f4d375-5dd8-4e77-887c-7263741d2456 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:48.620708 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-7a4ec596-3f4b-4434-822c-fa1e47d0f1de tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468" status: 200 len: 1679 microversion: 2.1 time: 0.170799 Oct 19 00:48:48.621962 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 514/1011] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:48 2022] GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:48.625110 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-50f4d375-5dd8-4e77-887c-7263741d2456 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:48.625605 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-50f4d375-5dd8-4e77-887c-7263741d2456 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:48.626278 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-50f4d375-5dd8-4e77-887c-7263741d2456 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:48.633661 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-50f4d375-5dd8-4e77-887c-7263741d2456 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:48.634456 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-50f4d375-5dd8-4e77-887c-7263741d2456 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:48.635080 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-50f4d375-5dd8-4e77-887c-7263741d2456 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:48.808540 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-50f4d375-5dd8-4e77-887c-7263741d2456 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:48.816350 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-50f4d375-5dd8-4e77-887c-7263741d2456 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1567 microversion: 2.1 time: 0.213432 Oct 19 00:48:48.816925 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 498/1012] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:48 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1567 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:48:49.644389 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-87a84a60-8da1-4aaa-99ad-c05080c0438f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:49.645009 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-87a84a60-8da1-4aaa-99ad-c05080c0438f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: a47e01df-7873-48e6-9df8-6bcf54a0f468] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:49.651773 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-87a84a60-8da1-4aaa-99ad-c05080c0438f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:49.652315 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-87a84a60-8da1-4aaa-99ad-c05080c0438f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:49.652746 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-87a84a60-8da1-4aaa-99ad-c05080c0438f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:49.653476 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-87a84a60-8da1-4aaa-99ad-c05080c0438f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:49.653933 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-87a84a60-8da1-4aaa-99ad-c05080c0438f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:49.654366 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-87a84a60-8da1-4aaa-99ad-c05080c0438f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:49.784819 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-87a84a60-8da1-4aaa-99ad-c05080c0438f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:49.792923 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-87a84a60-8da1-4aaa-99ad-c05080c0438f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468" status: 200 len: 1679 microversion: 2.1 time: 0.152325 Oct 19 00:48:49.793569 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 515/1013] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:49 2022] GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:49.841159 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-3fb30871-401a-4b56-8058-48348ac66614 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:49.841787 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-3fb30871-401a-4b56-8058-48348ac66614 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:49.848218 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3fb30871-401a-4b56-8058-48348ac66614 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:49.848700 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3fb30871-401a-4b56-8058-48348ac66614 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:49.849134 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3fb30871-401a-4b56-8058-48348ac66614 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:49.849820 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3fb30871-401a-4b56-8058-48348ac66614 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:49.850269 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3fb30871-401a-4b56-8058-48348ac66614 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:49.850684 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-3fb30871-401a-4b56-8058-48348ac66614 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:49.990141 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-3fb30871-401a-4b56-8058-48348ac66614 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:49.998612 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-3fb30871-401a-4b56-8058-48348ac66614 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1567 microversion: 2.1 time: 0.162595 Oct 19 00:48:49.999743 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 499/1014] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:49 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:50.817125 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-5c4eabf6-131e-4ba8-95c3-8ef160b1b2a3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:50.817778 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-5c4eabf6-131e-4ba8-95c3-8ef160b1b2a3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: a47e01df-7873-48e6-9df8-6bcf54a0f468] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:50.825157 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5c4eabf6-131e-4ba8-95c3-8ef160b1b2a3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:50.825650 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5c4eabf6-131e-4ba8-95c3-8ef160b1b2a3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:50.826088 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5c4eabf6-131e-4ba8-95c3-8ef160b1b2a3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:50.826795 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5c4eabf6-131e-4ba8-95c3-8ef160b1b2a3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:50.827250 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5c4eabf6-131e-4ba8-95c3-8ef160b1b2a3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:50.827676 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-5c4eabf6-131e-4ba8-95c3-8ef160b1b2a3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:51.024352 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-217009e6-bd04-45ca-b7a9-0cef6750a56d tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:51.025044 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-217009e6-bd04-45ca-b7a9-0cef6750a56d tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:51.036646 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-217009e6-bd04-45ca-b7a9-0cef6750a56d tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:51.037137 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-217009e6-bd04-45ca-b7a9-0cef6750a56d tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:51.037582 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-217009e6-bd04-45ca-b7a9-0cef6750a56d tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:51.038288 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-217009e6-bd04-45ca-b7a9-0cef6750a56d tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:51.038765 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-217009e6-bd04-45ca-b7a9-0cef6750a56d tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:51.039178 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-217009e6-bd04-45ca-b7a9-0cef6750a56d tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:51.146252 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-5c4eabf6-131e-4ba8-95c3-8ef160b1b2a3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:51.158187 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-5c4eabf6-131e-4ba8-95c3-8ef160b1b2a3 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468" status: 200 len: 1679 microversion: 2.1 time: 0.343247 Oct 19 00:48:51.159375 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 516/1015] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:50 2022] GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468 => generated 1679 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:51.187904 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-217009e6-bd04-45ca-b7a9-0cef6750a56d tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:51.197639 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-217009e6-bd04-45ca-b7a9-0cef6750a56d tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1567 microversion: 2.1 time: 0.177464 Oct 19 00:48:51.203588 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 500/1016] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:51 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:48:51.582779 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-63393301-601f-416d-aa09-77a7b340a868 req-7096cd82-e869-4c20-ac3d-b2fa350b0493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a47e01df-7873-48e6-9df8-6bcf54a0f468", "name": "network-vif-deleted", "tag": "6bbea366-c3a9-4be5-9b0a-2327f4e99ff1"}]} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:51.594998 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-63393301-601f-416d-aa09-77a7b340a868 req-7096cd82-e869-4c20-ac3d-b2fa350b0493 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:51.595535 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-63393301-601f-416d-aa09-77a7b340a868 req-7096cd82-e869-4c20-ac3d-b2fa350b0493 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:51.596060 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-63393301-601f-416d-aa09-77a7b340a868 req-7096cd82-e869-4c20-ac3d-b2fa350b0493 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:51.609815 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.compute.server_external_events [req-63393301-601f-416d-aa09-77a7b340a868 req-7096cd82-e869-4c20-ac3d-b2fa350b0493 service nova] Creating event network-vif-deleted:6bbea366-c3a9-4be5-9b0a-2327f4e99ff1 for instance a47e01df-7873-48e6-9df8-6bcf54a0f468 on hv-cinder-maste Oct 19 00:48:51.616849 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-63393301-601f-416d-aa09-77a7b340a868 req-7096cd82-e869-4c20-ac3d-b2fa350b0493 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037624 Oct 19 00:48:51.618119 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 517/1017] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:52.182501 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-84f3871d-9d62-4777-a18c-c13666868a83 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:52.183712 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-84f3871d-9d62-4777-a18c-c13666868a83 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: a47e01df-7873-48e6-9df8-6bcf54a0f468] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:52.190520 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-84f3871d-9d62-4777-a18c-c13666868a83 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:52.191002 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-84f3871d-9d62-4777-a18c-c13666868a83 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:52.191439 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-84f3871d-9d62-4777-a18c-c13666868a83 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:52.192414 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-84f3871d-9d62-4777-a18c-c13666868a83 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:52.193241 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-84f3871d-9d62-4777-a18c-c13666868a83 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:52.193988 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-84f3871d-9d62-4777-a18c-c13666868a83 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:52.221791 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-8fc9a574-cb1e-4390-8251-f20d5bbad272 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:52.222479 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-8fc9a574-cb1e-4390-8251-f20d5bbad272 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:52.234824 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8fc9a574-cb1e-4390-8251-f20d5bbad272 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:52.235437 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8fc9a574-cb1e-4390-8251-f20d5bbad272 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:52.235967 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8fc9a574-cb1e-4390-8251-f20d5bbad272 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:52.236702 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8fc9a574-cb1e-4390-8251-f20d5bbad272 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:52.237165 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8fc9a574-cb1e-4390-8251-f20d5bbad272 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:52.238189 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8fc9a574-cb1e-4390-8251-f20d5bbad272 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:52.247897 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-84f3871d-9d62-4777-a18c-c13666868a83 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:52.249811 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-84f3871d-9d62-4777-a18c-c13666868a83 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:52.250318 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-84f3871d-9d62-4777-a18c-c13666868a83 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:52.250849 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.objects.instance [None req-84f3871d-9d62-4777-a18c-c13666868a83 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lazy-loading 'fault' on Instance uuid a47e01df-7873-48e6-9df8-6bcf54a0f468 {{(pid=125531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:48:52.306057 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-84f3871d-9d62-4777-a18c-c13666868a83 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9a55c605f04f478d0a71679d8bf6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4081d4f735b04367a67a03b9539f5432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:52.313735 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-84f3871d-9d62-4777-a18c-c13666868a83 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468" status: 200 len: 1331 microversion: 2.1 time: 0.135600 Oct 19 00:48:52.314673 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 501/1018] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:52 2022] GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468 => generated 1331 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:52.400398 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-8fc9a574-cb1e-4390-8251-f20d5bbad272 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:52.410113 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-8fc9a574-cb1e-4390-8251-f20d5bbad272 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1567 microversion: 2.1 time: 0.192106 Oct 19 00:48:52.411395 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 518/1019] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:52 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1567 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:53.337787 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-df2923f8-70b6-4b30-80f3-7319e635e749 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:53.338389 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-df2923f8-70b6-4b30-80f3-7319e635e749 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: a47e01df-7873-48e6-9df8-6bcf54a0f468] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:53.345051 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-df2923f8-70b6-4b30-80f3-7319e635e749 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:53.345534 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-df2923f8-70b6-4b30-80f3-7319e635e749 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:53.345967 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-df2923f8-70b6-4b30-80f3-7319e635e749 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:53.346660 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-df2923f8-70b6-4b30-80f3-7319e635e749 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:53.347107 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-df2923f8-70b6-4b30-80f3-7319e635e749 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:53.347532 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-df2923f8-70b6-4b30-80f3-7319e635e749 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:53.361071 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.wsgi [None req-df2923f8-70b6-4b30-80f3-7319e635e749 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] HTTP exception thrown: Instance a47e01df-7873-48e6-9df8-6bcf54a0f468 could not be found. Oct 19 00:48:53.362762 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-df2923f8-70b6-4b30-80f3-7319e635e749 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Request method failure captured: Oct 19 00:48:53.362762 dv-cinder-master-3-smb devstack@n-api.service[125531]: request: GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468 HTTP/1.1 Oct 19 00:48:53.362762 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept: application/json Oct 19 00:48:53.362762 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept-Encoding: identity Oct 19 00:48:53.362762 dv-cinder-master-3-smb devstack@n-api.service[125531]: Connection: close Oct 19 00:48:53.362762 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Length: 0 Oct 19 00:48:53.362762 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Type: application/json Oct 19 00:48:53.362762 dv-cinder-master-3-smb devstack@n-api.service[125531]: Host: 10.222.0.33 Oct 19 00:48:53.362762 dv-cinder-master-3-smb devstack@n-api.service[125531]: Openstack-System-Scope: None Oct 19 00:48:53.362762 dv-cinder-master-3-smb devstack@n-api.service[125531]: User-Agent: python-urllib3/1.26.12 Oct 19 00:48:53.362762 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Auth-Token: gAAAAABjT0dZO9Cl1BpR1E_5nrd-9g_6W01GCmRr-bxs2oosEmvGRcrx0Y-G0IKovE-TfQsuTKO_S4_zWYg0zNU477VxKqXUVmnxsIfPQLMl-kk4S2RGLMvzztHdGHZY35kfzLdr41wbpFPN7pnfATDs8WY4-rnm9WtQvzLBNibrb2MPfqFKqcA Oct 19 00:48:53.362762 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Id: None Oct 19 00:48:53.362762 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Name: None Oct 19 00:48:53.362762 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Identity-Status: Confirmed Oct 19 00:48:53.362762 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Is-Admin-Project: True Oct 19 00:48:53.362762 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Id: default Oct 19 00:48:53.362762 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Name: Default Oct 19 00:48:53.362762 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Id: 4081d4f735b04367a67a03b9539f5432 Oct 19 00:48:53.362762 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Name: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:48:53.362762 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Role: member,reader Oct 19 00:48:53.362762 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Roles: member,reader Oct 19 00:48:53.364970 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4081d4f735b04367a67a03b9539f5432"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:48:53.364970 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:48:53.364970 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Id: 4081d4f735b04367a67a03b9539f5432 Oct 19 00:48:53.364970 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:48:53.364970 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User: tempest-AttachVolumeNegativeTest-339799867-project Oct 19 00:48:53.364970 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Id: default Oct 19 00:48:53.364970 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Name: Default Oct 19 00:48:53.364970 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Id: 5f9a55c605f04f478d0a71679d8bf6a1 Oct 19 00:48:53.364970 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Name: tempest-AttachVolumeNegativeTest-339799867-project Oct 19 00:48:53.364970 dv-cinder-master-3-smb devstack@n-api.service[125531]: method: > Oct 19 00:48:53.364970 dv-cinder-master-3-smb devstack@n-api.service[125531]: exception: Instance a47e01df-7873-48e6-9df8-6bcf54a0f468 could not be found. Oct 19 00:48:53.364970 dv-cinder-master-3-smb devstack@n-api.service[125531]: action_args: {'id': 'a47e01df-7873-48e6-9df8-6bcf54a0f468'} Oct 19 00:48:53.365951 dv-cinder-master-3-smb devstack@n-api.service[125531]: {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:48:53.365951 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:53.365951 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:48:53.365951 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:48:53.365951 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:48:53.365951 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:48:53.365951 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:48:53.365951 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:48:53.365951 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:48:53.365951 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:48:53.365951 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a47e01df-7873-48e6-9df8-6bcf54a0f468 could not be found. Oct 19 00:48:53.365951 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:48:53.365951 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:53.365951 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:48:53.365951 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:53.365951 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:53.365951 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:53.365951 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:48:53.365951 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:48:53.365951 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:48:53.367548 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:48:53.367548 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:48:53.367548 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:48:53.367548 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:48:53.367548 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:48:53.367548 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:48:53.367548 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:48:53.367548 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a47e01df-7873-48e6-9df8-6bcf54a0f468 could not be found. Oct 19 00:48:53.367548 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:48:53.367548 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:53.367548 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:48:53.367548 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:53.367548 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:53.367548 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:53.367548 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:48:53.367548 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:48:53.367548 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a47e01df-7873-48e6-9df8-6bcf54a0f468 could not be found. Oct 19 00:48:53.367548 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:48:53.368944 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-df2923f8-70b6-4b30-80f3-7319e635e749 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Returning 404 to user: Instance a47e01df-7873-48e6-9df8-6bcf54a0f468 could not be found. {{(pid=125531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:48:53.368944 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-df2923f8-70b6-4b30-80f3-7319e635e749 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468" status: 404 len: 111 microversion: 2.1 time: 0.030254 Oct 19 00:48:53.368944 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 502/1020] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:53 2022] GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:48:53.373858 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-50261e82-1b2e-4768-bc5d-d1a344ea9775 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '.version_select at 0x7f81f0fb5430>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:53.380811 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:53.395093 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-50261e82-1b2e-4768-bc5d-d1a344ea9775 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1520945711" status: 202 len: 0 microversion: 2.1 time: 0.025877 Oct 19 00:48:53.395696 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 519/1021] 10.222.0.33 () {58 vars in 1221 bytes} [Wed Oct 19 00:48:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1520945711 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 00:48:53.435237 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-dbf0f91c-90ad-4fb8-9f32-92420484e831 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:53.435986 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-dbf0f91c-90ad-4fb8-9f32-92420484e831 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:53.442097 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dbf0f91c-90ad-4fb8-9f32-92420484e831 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:53.442772 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dbf0f91c-90ad-4fb8-9f32-92420484e831 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:53.443269 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dbf0f91c-90ad-4fb8-9f32-92420484e831 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:53.444096 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dbf0f91c-90ad-4fb8-9f32-92420484e831 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:53.445018 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dbf0f91c-90ad-4fb8-9f32-92420484e831 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:53.445146 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dbf0f91c-90ad-4fb8-9f32-92420484e831 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:53.632845 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-dbf0f91c-90ad-4fb8-9f32-92420484e831 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:53.652058 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-dbf0f91c-90ad-4fb8-9f32-92420484e831 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1567 microversion: 2.1 time: 0.221196 Oct 19 00:48:53.652785 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 503/1022] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:53 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:54.677169 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-2a5e7ad1-b072-4787-b5c6-af7e724240e8 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:54.677720 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-2a5e7ad1-b072-4787-b5c6-af7e724240e8 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:54.684345 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2a5e7ad1-b072-4787-b5c6-af7e724240e8 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:54.684828 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2a5e7ad1-b072-4787-b5c6-af7e724240e8 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:54.685275 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2a5e7ad1-b072-4787-b5c6-af7e724240e8 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:54.685965 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2a5e7ad1-b072-4787-b5c6-af7e724240e8 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:54.686417 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2a5e7ad1-b072-4787-b5c6-af7e724240e8 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:54.686878 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2a5e7ad1-b072-4787-b5c6-af7e724240e8 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:54.823785 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-2a5e7ad1-b072-4787-b5c6-af7e724240e8 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:54.831649 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-2a5e7ad1-b072-4787-b5c6-af7e724240e8 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1567 microversion: 2.1 time: 0.159003 Oct 19 00:48:54.832237 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 520/1023] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:54 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:55.440063 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-e46e34b3-5894-4e5e-b432-dd58e293aef2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:55.440745 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-e46e34b3-5894-4e5e-b432-dd58e293aef2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: a47e01df-7873-48e6-9df8-6bcf54a0f468] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:55.448077 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e46e34b3-5894-4e5e-b432-dd58e293aef2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:55.448643 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e46e34b3-5894-4e5e-b432-dd58e293aef2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:55.449152 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e46e34b3-5894-4e5e-b432-dd58e293aef2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:55.449923 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e46e34b3-5894-4e5e-b432-dd58e293aef2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:55.450457 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e46e34b3-5894-4e5e-b432-dd58e293aef2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:55.450952 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e46e34b3-5894-4e5e-b432-dd58e293aef2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:55.465401 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.wsgi [None req-e46e34b3-5894-4e5e-b432-dd58e293aef2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] HTTP exception thrown: Instance a47e01df-7873-48e6-9df8-6bcf54a0f468 could not be found. Oct 19 00:48:55.467148 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-e46e34b3-5894-4e5e-b432-dd58e293aef2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Request method failure captured: Oct 19 00:48:55.467148 dv-cinder-master-3-smb devstack@n-api.service[125531]: request: DELETE /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468 HTTP/1.1 Oct 19 00:48:55.467148 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept: application/json Oct 19 00:48:55.467148 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept-Encoding: identity Oct 19 00:48:55.467148 dv-cinder-master-3-smb devstack@n-api.service[125531]: Connection: close Oct 19 00:48:55.467148 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Length: 0 Oct 19 00:48:55.467148 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Type: application/json Oct 19 00:48:55.467148 dv-cinder-master-3-smb devstack@n-api.service[125531]: Host: 10.222.0.33 Oct 19 00:48:55.467148 dv-cinder-master-3-smb devstack@n-api.service[125531]: Openstack-System-Scope: None Oct 19 00:48:55.467148 dv-cinder-master-3-smb devstack@n-api.service[125531]: User-Agent: python-urllib3/1.26.12 Oct 19 00:48:55.467148 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Auth-Token: gAAAAABjT0dZO9Cl1BpR1E_5nrd-9g_6W01GCmRr-bxs2oosEmvGRcrx0Y-G0IKovE-TfQsuTKO_S4_zWYg0zNU477VxKqXUVmnxsIfPQLMl-kk4S2RGLMvzztHdGHZY35kfzLdr41wbpFPN7pnfATDs8WY4-rnm9WtQvzLBNibrb2MPfqFKqcA Oct 19 00:48:55.467148 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Id: None Oct 19 00:48:55.467148 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Name: None Oct 19 00:48:55.467148 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Identity-Status: Confirmed Oct 19 00:48:55.467148 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Is-Admin-Project: True Oct 19 00:48:55.467148 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Id: default Oct 19 00:48:55.467148 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Name: Default Oct 19 00:48:55.467148 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Id: 4081d4f735b04367a67a03b9539f5432 Oct 19 00:48:55.467148 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Name: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:48:55.467148 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Role: member,reader Oct 19 00:48:55.467148 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Roles: member,reader Oct 19 00:48:55.468875 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4081d4f735b04367a67a03b9539f5432"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:48:55.468875 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:48:55.468875 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Id: 4081d4f735b04367a67a03b9539f5432 Oct 19 00:48:55.468875 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:48:55.468875 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User: tempest-AttachVolumeNegativeTest-339799867-project Oct 19 00:48:55.468875 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Id: default Oct 19 00:48:55.468875 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Name: Default Oct 19 00:48:55.468875 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Id: 5f9a55c605f04f478d0a71679d8bf6a1 Oct 19 00:48:55.468875 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Name: tempest-AttachVolumeNegativeTest-339799867-project Oct 19 00:48:55.468875 dv-cinder-master-3-smb devstack@n-api.service[125531]: method: > Oct 19 00:48:55.468875 dv-cinder-master-3-smb devstack@n-api.service[125531]: exception: Instance a47e01df-7873-48e6-9df8-6bcf54a0f468 could not be found. Oct 19 00:48:55.468875 dv-cinder-master-3-smb devstack@n-api.service[125531]: action_args: {'id': 'a47e01df-7873-48e6-9df8-6bcf54a0f468'} Oct 19 00:48:55.469811 dv-cinder-master-3-smb devstack@n-api.service[125531]: {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:48:55.469811 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:55.469811 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:48:55.469811 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:48:55.469811 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:48:55.469811 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:48:55.469811 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:48:55.469811 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:48:55.469811 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:48:55.469811 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:48:55.469811 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a47e01df-7873-48e6-9df8-6bcf54a0f468 could not be found. Oct 19 00:48:55.469811 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:48:55.469811 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:55.469811 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:48:55.469811 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:55.469811 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:55.469811 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:55.469811 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:48:55.469811 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:48:55.469811 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:48:55.471069 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:48:55.471069 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 00:48:55.471069 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 00:48:55.471069 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 00:48:55.471069 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 00:48:55.471069 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:48:55.471069 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:48:55.471069 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:48:55.471069 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:48:55.471069 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a47e01df-7873-48e6-9df8-6bcf54a0f468 could not be found. Oct 19 00:48:55.471069 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:48:55.471069 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:55.471069 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:48:55.471069 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:55.471069 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:55.471069 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:55.471069 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:48:55.471069 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:48:55.471069 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a47e01df-7873-48e6-9df8-6bcf54a0f468 could not be found. Oct 19 00:48:55.471069 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:48:55.472383 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-e46e34b3-5894-4e5e-b432-dd58e293aef2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Returning 404 to user: Instance a47e01df-7873-48e6-9df8-6bcf54a0f468 could not be found. {{(pid=125531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:48:55.472383 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-e46e34b3-5894-4e5e-b432-dd58e293aef2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468" status: 404 len: 111 microversion: 2.1 time: 0.033576 Oct 19 00:48:55.472383 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 504/1024] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Oct 19 00:48:55 2022] DELETE /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:48:55.477908 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-19afc066-19ce-4ee2-b1ba-bb4ac636072f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:55.478521 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-19afc066-19ce-4ee2-b1ba-bb4ac636072f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: a47e01df-7873-48e6-9df8-6bcf54a0f468] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:55.485369 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-19afc066-19ce-4ee2-b1ba-bb4ac636072f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:55.485849 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-19afc066-19ce-4ee2-b1ba-bb4ac636072f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:55.486518 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-19afc066-19ce-4ee2-b1ba-bb4ac636072f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:55.487214 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-19afc066-19ce-4ee2-b1ba-bb4ac636072f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:55.487825 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-19afc066-19ce-4ee2-b1ba-bb4ac636072f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:55.488286 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-19afc066-19ce-4ee2-b1ba-bb4ac636072f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:55.503348 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.wsgi [None req-19afc066-19ce-4ee2-b1ba-bb4ac636072f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] HTTP exception thrown: Instance a47e01df-7873-48e6-9df8-6bcf54a0f468 could not be found. Oct 19 00:48:55.505049 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-19afc066-19ce-4ee2-b1ba-bb4ac636072f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Request method failure captured: Oct 19 00:48:55.505049 dv-cinder-master-3-smb devstack@n-api.service[125532]: request: GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468 HTTP/1.1 Oct 19 00:48:55.505049 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept: application/json Oct 19 00:48:55.505049 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept-Encoding: identity Oct 19 00:48:55.505049 dv-cinder-master-3-smb devstack@n-api.service[125532]: Connection: close Oct 19 00:48:55.505049 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Length: 0 Oct 19 00:48:55.505049 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Type: application/json Oct 19 00:48:55.505049 dv-cinder-master-3-smb devstack@n-api.service[125532]: Host: 10.222.0.33 Oct 19 00:48:55.505049 dv-cinder-master-3-smb devstack@n-api.service[125532]: Openstack-System-Scope: None Oct 19 00:48:55.505049 dv-cinder-master-3-smb devstack@n-api.service[125532]: User-Agent: python-urllib3/1.26.12 Oct 19 00:48:55.505049 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Auth-Token: gAAAAABjT0dZO9Cl1BpR1E_5nrd-9g_6W01GCmRr-bxs2oosEmvGRcrx0Y-G0IKovE-TfQsuTKO_S4_zWYg0zNU477VxKqXUVmnxsIfPQLMl-kk4S2RGLMvzztHdGHZY35kfzLdr41wbpFPN7pnfATDs8WY4-rnm9WtQvzLBNibrb2MPfqFKqcA Oct 19 00:48:55.505049 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Id: None Oct 19 00:48:55.505049 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Name: None Oct 19 00:48:55.505049 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Identity-Status: Confirmed Oct 19 00:48:55.505049 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Is-Admin-Project: True Oct 19 00:48:55.505049 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Id: default Oct 19 00:48:55.505049 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Name: Default Oct 19 00:48:55.505049 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Id: 4081d4f735b04367a67a03b9539f5432 Oct 19 00:48:55.505049 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Name: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:48:55.505049 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Role: member,reader Oct 19 00:48:55.505049 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Roles: member,reader Oct 19 00:48:55.506606 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4081d4f735b04367a67a03b9539f5432"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:48:55.506606 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:48:55.506606 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Id: 4081d4f735b04367a67a03b9539f5432 Oct 19 00:48:55.506606 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:48:55.506606 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User: tempest-AttachVolumeNegativeTest-339799867-project Oct 19 00:48:55.506606 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Id: default Oct 19 00:48:55.506606 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Name: Default Oct 19 00:48:55.506606 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Id: 5f9a55c605f04f478d0a71679d8bf6a1 Oct 19 00:48:55.506606 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Name: tempest-AttachVolumeNegativeTest-339799867-project Oct 19 00:48:55.506606 dv-cinder-master-3-smb devstack@n-api.service[125532]: method: > Oct 19 00:48:55.506606 dv-cinder-master-3-smb devstack@n-api.service[125532]: exception: Instance a47e01df-7873-48e6-9df8-6bcf54a0f468 could not be found. Oct 19 00:48:55.506606 dv-cinder-master-3-smb devstack@n-api.service[125532]: action_args: {'id': 'a47e01df-7873-48e6-9df8-6bcf54a0f468'} Oct 19 00:48:55.507414 dv-cinder-master-3-smb devstack@n-api.service[125532]: {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:48:55.507414 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:55.507414 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:48:55.507414 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:48:55.507414 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:48:55.507414 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:48:55.507414 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:48:55.507414 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:48:55.507414 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:48:55.507414 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:48:55.507414 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a47e01df-7873-48e6-9df8-6bcf54a0f468 could not be found. Oct 19 00:48:55.507414 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:48:55.507414 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:55.507414 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:48:55.507414 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:55.507414 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:55.507414 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:55.507414 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:48:55.507414 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:48:55.507414 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:48:55.508790 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:48:55.508790 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:48:55.508790 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:48:55.508790 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:48:55.508790 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:48:55.508790 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:48:55.508790 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:48:55.508790 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a47e01df-7873-48e6-9df8-6bcf54a0f468 could not be found. Oct 19 00:48:55.508790 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:48:55.508790 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:55.508790 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:48:55.508790 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:55.508790 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:55.508790 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:55.508790 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:48:55.508790 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:48:55.508790 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a47e01df-7873-48e6-9df8-6bcf54a0f468 could not be found. Oct 19 00:48:55.508790 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:48:55.510631 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-19afc066-19ce-4ee2-b1ba-bb4ac636072f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Returning 404 to user: Instance a47e01df-7873-48e6-9df8-6bcf54a0f468 could not be found. {{(pid=125532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:48:55.510631 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-19afc066-19ce-4ee2-b1ba-bb4ac636072f tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468" status: 404 len: 111 microversion: 2.1 time: 0.032490 Oct 19 00:48:55.510631 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 521/1025] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:55 2022] GET /compute/v2.1/servers/a47e01df-7873-48e6-9df8-6bcf54a0f468 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:48:55.859419 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-25ec4945-fd4f-4099-a6fb-b575e88c16dd tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:55.860454 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-25ec4945-fd4f-4099-a6fb-b575e88c16dd tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:55.865990 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:55.869909 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-25ec4945-fd4f-4099-a6fb-b575e88c16dd tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:55.871090 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-25ec4945-fd4f-4099-a6fb-b575e88c16dd tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:55.871703 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-25ec4945-fd4f-4099-a6fb-b575e88c16dd tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:55.872761 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-25ec4945-fd4f-4099-a6fb-b575e88c16dd tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:55.873388 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-25ec4945-fd4f-4099-a6fb-b575e88c16dd tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:55.873911 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-25ec4945-fd4f-4099-a6fb-b575e88c16dd tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:55.896830 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:56.071880 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-25ec4945-fd4f-4099-a6fb-b575e88c16dd tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:56.079835 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-25ec4945-fd4f-4099-a6fb-b575e88c16dd tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1568 microversion: 2.1 time: 0.227972 Oct 19 00:48:56.080457 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 505/1026] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:55 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1568 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:56.102366 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-2a0896ed-dd8f-4bf1-8b15-12274e057a68 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:56.103070 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-2a0896ed-dd8f-4bf1-8b15-12274e057a68 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:56.110083 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2a0896ed-dd8f-4bf1-8b15-12274e057a68 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:56.110640 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2a0896ed-dd8f-4bf1-8b15-12274e057a68 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:56.111139 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2a0896ed-dd8f-4bf1-8b15-12274e057a68 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:56.111981 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2a0896ed-dd8f-4bf1-8b15-12274e057a68 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:56.114947 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2a0896ed-dd8f-4bf1-8b15-12274e057a68 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:56.114947 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2a0896ed-dd8f-4bf1-8b15-12274e057a68 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:56.143242 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-2a0896ed-dd8f-4bf1-8b15-12274e057a68 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125532) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 19 00:48:56.221288 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-2a0896ed-dd8f-4bf1-8b15-12274e057a68 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "POST /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9/action" status: 202 len: 0 microversion: 2.1 time: 0.122688 Oct 19 00:48:56.222129 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 522/1027] 10.222.0.33 () {60 vars in 1278 bytes} [Wed Oct 19 00:48:56 2022] POST /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:48:56.232108 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-6ba8f29c-dd45-401f-b80a-260ab36f3dcb tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:56.233919 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-6ba8f29c-dd45-401f-b80a-260ab36f3dcb tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:56.240271 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6ba8f29c-dd45-401f-b80a-260ab36f3dcb tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:56.241309 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6ba8f29c-dd45-401f-b80a-260ab36f3dcb tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:56.241997 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6ba8f29c-dd45-401f-b80a-260ab36f3dcb tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:56.243052 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6ba8f29c-dd45-401f-b80a-260ab36f3dcb tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:56.243791 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6ba8f29c-dd45-401f-b80a-260ab36f3dcb tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:56.244578 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6ba8f29c-dd45-401f-b80a-260ab36f3dcb tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:56.397169 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-6ba8f29c-dd45-401f-b80a-260ab36f3dcb tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:56.406316 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-6ba8f29c-dd45-401f-b80a-260ab36f3dcb tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1576 microversion: 2.1 time: 0.179384 Oct 19 00:48:56.406975 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 506/1028] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:56 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1576 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:56.669632 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-eb15b936-40f6-4b25-981d-2f0ac57ac2e2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:56.669995 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-eb15b936-40f6-4b25-981d-2f0ac57ac2e2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: bf3b9e96-22bd-44d1-9871-6a454de72bbe] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:56.676149 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-eb15b936-40f6-4b25-981d-2f0ac57ac2e2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:56.676639 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-eb15b936-40f6-4b25-981d-2f0ac57ac2e2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:56.677062 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-eb15b936-40f6-4b25-981d-2f0ac57ac2e2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:56.677749 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-eb15b936-40f6-4b25-981d-2f0ac57ac2e2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:56.678382 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-eb15b936-40f6-4b25-981d-2f0ac57ac2e2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:56.678801 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-eb15b936-40f6-4b25-981d-2f0ac57ac2e2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:56.695171 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.wsgi [None req-eb15b936-40f6-4b25-981d-2f0ac57ac2e2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] HTTP exception thrown: Instance bf3b9e96-22bd-44d1-9871-6a454de72bbe could not be found. Oct 19 00:48:56.696781 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-eb15b936-40f6-4b25-981d-2f0ac57ac2e2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Request method failure captured: Oct 19 00:48:56.696781 dv-cinder-master-3-smb devstack@n-api.service[125532]: request: DELETE /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe HTTP/1.1 Oct 19 00:48:56.696781 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept: application/json Oct 19 00:48:56.696781 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept-Encoding: identity Oct 19 00:48:56.696781 dv-cinder-master-3-smb devstack@n-api.service[125532]: Connection: close Oct 19 00:48:56.696781 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Length: 0 Oct 19 00:48:56.696781 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Type: application/json Oct 19 00:48:56.696781 dv-cinder-master-3-smb devstack@n-api.service[125532]: Host: 10.222.0.33 Oct 19 00:48:56.696781 dv-cinder-master-3-smb devstack@n-api.service[125532]: Openstack-System-Scope: None Oct 19 00:48:56.696781 dv-cinder-master-3-smb devstack@n-api.service[125532]: User-Agent: python-urllib3/1.26.12 Oct 19 00:48:56.696781 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Auth-Token: gAAAAABjT0dZO9Cl1BpR1E_5nrd-9g_6W01GCmRr-bxs2oosEmvGRcrx0Y-G0IKovE-TfQsuTKO_S4_zWYg0zNU477VxKqXUVmnxsIfPQLMl-kk4S2RGLMvzztHdGHZY35kfzLdr41wbpFPN7pnfATDs8WY4-rnm9WtQvzLBNibrb2MPfqFKqcA Oct 19 00:48:56.696781 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Id: None Oct 19 00:48:56.696781 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Name: None Oct 19 00:48:56.696781 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Identity-Status: Confirmed Oct 19 00:48:56.696781 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Is-Admin-Project: True Oct 19 00:48:56.696781 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Id: default Oct 19 00:48:56.696781 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Name: Default Oct 19 00:48:56.696781 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Id: 4081d4f735b04367a67a03b9539f5432 Oct 19 00:48:56.696781 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Name: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:48:56.696781 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Role: member,reader Oct 19 00:48:56.696781 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Roles: member,reader Oct 19 00:48:56.698610 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4081d4f735b04367a67a03b9539f5432"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:48:56.698610 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:48:56.698610 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Id: 4081d4f735b04367a67a03b9539f5432 Oct 19 00:48:56.698610 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:48:56.698610 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User: tempest-AttachVolumeNegativeTest-339799867-project Oct 19 00:48:56.698610 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Id: default Oct 19 00:48:56.698610 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Name: Default Oct 19 00:48:56.698610 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Id: 5f9a55c605f04f478d0a71679d8bf6a1 Oct 19 00:48:56.698610 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Name: tempest-AttachVolumeNegativeTest-339799867-project Oct 19 00:48:56.698610 dv-cinder-master-3-smb devstack@n-api.service[125532]: method: > Oct 19 00:48:56.698610 dv-cinder-master-3-smb devstack@n-api.service[125532]: exception: Instance bf3b9e96-22bd-44d1-9871-6a454de72bbe could not be found. Oct 19 00:48:56.698610 dv-cinder-master-3-smb devstack@n-api.service[125532]: action_args: {'id': 'bf3b9e96-22bd-44d1-9871-6a454de72bbe'} Oct 19 00:48:56.702186 dv-cinder-master-3-smb devstack@n-api.service[125532]: {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:48:56.702186 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:56.702186 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:48:56.702186 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:48:56.702186 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:48:56.702186 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:48:56.702186 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:48:56.702186 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:48:56.702186 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:48:56.702186 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:48:56.702186 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf3b9e96-22bd-44d1-9871-6a454de72bbe could not be found. Oct 19 00:48:56.702186 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:48:56.702186 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:56.702186 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:48:56.702186 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:56.702186 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:56.702186 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:56.702186 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:48:56.702186 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:48:56.702186 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:48:56.703682 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:48:56.703682 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 00:48:56.703682 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 00:48:56.703682 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 00:48:56.703682 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 00:48:56.703682 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:48:56.703682 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:48:56.703682 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:48:56.703682 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:48:56.703682 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf3b9e96-22bd-44d1-9871-6a454de72bbe could not be found. Oct 19 00:48:56.703682 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:48:56.703682 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:56.703682 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:48:56.703682 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:56.703682 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:56.703682 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:56.703682 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:48:56.703682 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:48:56.703682 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf3b9e96-22bd-44d1-9871-6a454de72bbe could not be found. Oct 19 00:48:56.703682 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:48:56.705487 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-eb15b936-40f6-4b25-981d-2f0ac57ac2e2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Returning 404 to user: Instance bf3b9e96-22bd-44d1-9871-6a454de72bbe could not be found. {{(pid=125532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:48:56.705487 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-eb15b936-40f6-4b25-981d-2f0ac57ac2e2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe" status: 404 len: 111 microversion: 2.1 time: 0.033766 Oct 19 00:48:56.705487 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 523/1029] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Oct 19 00:48:56 2022] DELETE /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:48:56.707420 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-2fa6001c-f251-4571-b923-8eca8672015e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:56.708295 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-2fa6001c-f251-4571-b923-8eca8672015e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: bf3b9e96-22bd-44d1-9871-6a454de72bbe] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:56.716149 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2fa6001c-f251-4571-b923-8eca8672015e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:56.716770 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2fa6001c-f251-4571-b923-8eca8672015e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:56.717221 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2fa6001c-f251-4571-b923-8eca8672015e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:56.718286 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2fa6001c-f251-4571-b923-8eca8672015e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:56.718756 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2fa6001c-f251-4571-b923-8eca8672015e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:56.719177 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-2fa6001c-f251-4571-b923-8eca8672015e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:56.736984 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.wsgi [None req-2fa6001c-f251-4571-b923-8eca8672015e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] HTTP exception thrown: Instance bf3b9e96-22bd-44d1-9871-6a454de72bbe could not be found. Oct 19 00:48:56.738670 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-2fa6001c-f251-4571-b923-8eca8672015e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Request method failure captured: Oct 19 00:48:56.738670 dv-cinder-master-3-smb devstack@n-api.service[125531]: request: GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe HTTP/1.1 Oct 19 00:48:56.738670 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept: application/json Oct 19 00:48:56.738670 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept-Encoding: identity Oct 19 00:48:56.738670 dv-cinder-master-3-smb devstack@n-api.service[125531]: Connection: close Oct 19 00:48:56.738670 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Length: 0 Oct 19 00:48:56.738670 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Type: application/json Oct 19 00:48:56.738670 dv-cinder-master-3-smb devstack@n-api.service[125531]: Host: 10.222.0.33 Oct 19 00:48:56.738670 dv-cinder-master-3-smb devstack@n-api.service[125531]: Openstack-System-Scope: None Oct 19 00:48:56.738670 dv-cinder-master-3-smb devstack@n-api.service[125531]: User-Agent: python-urllib3/1.26.12 Oct 19 00:48:56.738670 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Auth-Token: gAAAAABjT0dZO9Cl1BpR1E_5nrd-9g_6W01GCmRr-bxs2oosEmvGRcrx0Y-G0IKovE-TfQsuTKO_S4_zWYg0zNU477VxKqXUVmnxsIfPQLMl-kk4S2RGLMvzztHdGHZY35kfzLdr41wbpFPN7pnfATDs8WY4-rnm9WtQvzLBNibrb2MPfqFKqcA Oct 19 00:48:56.738670 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Id: None Oct 19 00:48:56.738670 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Name: None Oct 19 00:48:56.738670 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Identity-Status: Confirmed Oct 19 00:48:56.738670 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Is-Admin-Project: True Oct 19 00:48:56.738670 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Id: default Oct 19 00:48:56.738670 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Name: Default Oct 19 00:48:56.738670 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Id: 4081d4f735b04367a67a03b9539f5432 Oct 19 00:48:56.738670 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Name: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:48:56.738670 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Role: member,reader Oct 19 00:48:56.738670 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Roles: member,reader Oct 19 00:48:56.740346 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4081d4f735b04367a67a03b9539f5432"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:48:56.740346 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:48:56.740346 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Id: 4081d4f735b04367a67a03b9539f5432 Oct 19 00:48:56.740346 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:48:56.740346 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User: tempest-AttachVolumeNegativeTest-339799867-project Oct 19 00:48:56.740346 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Id: default Oct 19 00:48:56.740346 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Name: Default Oct 19 00:48:56.740346 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Id: 5f9a55c605f04f478d0a71679d8bf6a1 Oct 19 00:48:56.740346 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Name: tempest-AttachVolumeNegativeTest-339799867-project Oct 19 00:48:56.740346 dv-cinder-master-3-smb devstack@n-api.service[125531]: method: > Oct 19 00:48:56.740346 dv-cinder-master-3-smb devstack@n-api.service[125531]: exception: Instance bf3b9e96-22bd-44d1-9871-6a454de72bbe could not be found. Oct 19 00:48:56.740346 dv-cinder-master-3-smb devstack@n-api.service[125531]: action_args: {'id': 'bf3b9e96-22bd-44d1-9871-6a454de72bbe'} Oct 19 00:48:56.741264 dv-cinder-master-3-smb devstack@n-api.service[125531]: {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:48:56.741264 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:56.741264 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:48:56.741264 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:48:56.741264 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:48:56.741264 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:48:56.741264 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:48:56.741264 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:48:56.741264 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:48:56.741264 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:48:56.741264 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf3b9e96-22bd-44d1-9871-6a454de72bbe could not be found. Oct 19 00:48:56.741264 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:48:56.741264 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:56.741264 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:48:56.741264 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:56.741264 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:56.741264 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:56.741264 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:48:56.741264 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:48:56.741264 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:48:56.742750 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:48:56.742750 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:48:56.742750 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:48:56.742750 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:48:56.742750 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:48:56.742750 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:48:56.742750 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:48:56.742750 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf3b9e96-22bd-44d1-9871-6a454de72bbe could not be found. Oct 19 00:48:56.742750 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:48:56.742750 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:56.742750 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:48:56.742750 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:56.742750 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:56.742750 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:56.742750 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:48:56.742750 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:48:56.742750 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf3b9e96-22bd-44d1-9871-6a454de72bbe could not be found. Oct 19 00:48:56.742750 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:48:56.747687 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-2fa6001c-f251-4571-b923-8eca8672015e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Returning 404 to user: Instance bf3b9e96-22bd-44d1-9871-6a454de72bbe could not be found. {{(pid=125531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:48:56.747687 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-2fa6001c-f251-4571-b923-8eca8672015e tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe" status: 404 len: 111 microversion: 2.1 time: 0.038031 Oct 19 00:48:56.747687 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 507/1030] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:56 2022] GET /compute/v2.1/servers/bf3b9e96-22bd-44d1-9871-6a454de72bbe => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:48:56.753405 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-32d7821b-fc2c-4521-ae20-22e17f4a66cd tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:56.753836 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-32d7821b-fc2c-4521-ae20-22e17f4a66cd tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:56.760015 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-32d7821b-fc2c-4521-ae20-22e17f4a66cd tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:56.760627 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-32d7821b-fc2c-4521-ae20-22e17f4a66cd tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:56.760974 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-32d7821b-fc2c-4521-ae20-22e17f4a66cd tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:56.761677 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-32d7821b-fc2c-4521-ae20-22e17f4a66cd tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:56.762132 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-32d7821b-fc2c-4521-ae20-22e17f4a66cd tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:56.762557 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-32d7821b-fc2c-4521-ae20-22e17f4a66cd tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:56.776820 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.wsgi [None req-32d7821b-fc2c-4521-ae20-22e17f4a66cd tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] HTTP exception thrown: Instance 21c2af83-cdf5-43fb-b75e-287be2eb0db7 could not be found. Oct 19 00:48:56.778621 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-32d7821b-fc2c-4521-ae20-22e17f4a66cd tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Request method failure captured: Oct 19 00:48:56.778621 dv-cinder-master-3-smb devstack@n-api.service[125532]: request: DELETE /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 HTTP/1.1 Oct 19 00:48:56.778621 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept: application/json Oct 19 00:48:56.778621 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept-Encoding: identity Oct 19 00:48:56.778621 dv-cinder-master-3-smb devstack@n-api.service[125532]: Connection: close Oct 19 00:48:56.778621 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Length: 0 Oct 19 00:48:56.778621 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Type: application/json Oct 19 00:48:56.778621 dv-cinder-master-3-smb devstack@n-api.service[125532]: Host: 10.222.0.33 Oct 19 00:48:56.778621 dv-cinder-master-3-smb devstack@n-api.service[125532]: Openstack-System-Scope: None Oct 19 00:48:56.778621 dv-cinder-master-3-smb devstack@n-api.service[125532]: User-Agent: python-urllib3/1.26.12 Oct 19 00:48:56.778621 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Auth-Token: gAAAAABjT0dZO9Cl1BpR1E_5nrd-9g_6W01GCmRr-bxs2oosEmvGRcrx0Y-G0IKovE-TfQsuTKO_S4_zWYg0zNU477VxKqXUVmnxsIfPQLMl-kk4S2RGLMvzztHdGHZY35kfzLdr41wbpFPN7pnfATDs8WY4-rnm9WtQvzLBNibrb2MPfqFKqcA Oct 19 00:48:56.778621 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Id: None Oct 19 00:48:56.778621 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Name: None Oct 19 00:48:56.778621 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Identity-Status: Confirmed Oct 19 00:48:56.778621 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Is-Admin-Project: True Oct 19 00:48:56.778621 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Id: default Oct 19 00:48:56.778621 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Name: Default Oct 19 00:48:56.778621 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Id: 4081d4f735b04367a67a03b9539f5432 Oct 19 00:48:56.778621 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Name: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:48:56.778621 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Role: member,reader Oct 19 00:48:56.778621 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Roles: member,reader Oct 19 00:48:56.779999 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4081d4f735b04367a67a03b9539f5432"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:48:56.779999 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:48:56.779999 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Id: 4081d4f735b04367a67a03b9539f5432 Oct 19 00:48:56.779999 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:48:56.779999 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User: tempest-AttachVolumeNegativeTest-339799867-project Oct 19 00:48:56.779999 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Id: default Oct 19 00:48:56.779999 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Name: Default Oct 19 00:48:56.779999 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Id: 5f9a55c605f04f478d0a71679d8bf6a1 Oct 19 00:48:56.779999 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Name: tempest-AttachVolumeNegativeTest-339799867-project Oct 19 00:48:56.779999 dv-cinder-master-3-smb devstack@n-api.service[125532]: method: > Oct 19 00:48:56.779999 dv-cinder-master-3-smb devstack@n-api.service[125532]: exception: Instance 21c2af83-cdf5-43fb-b75e-287be2eb0db7 could not be found. Oct 19 00:48:56.779999 dv-cinder-master-3-smb devstack@n-api.service[125532]: action_args: {'id': '21c2af83-cdf5-43fb-b75e-287be2eb0db7'} Oct 19 00:48:56.780939 dv-cinder-master-3-smb devstack@n-api.service[125532]: {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:48:56.780939 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:56.780939 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:48:56.780939 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:48:56.780939 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:48:56.780939 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:48:56.780939 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:48:56.780939 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:48:56.780939 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:48:56.780939 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:48:56.780939 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21c2af83-cdf5-43fb-b75e-287be2eb0db7 could not be found. Oct 19 00:48:56.780939 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:48:56.780939 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:56.780939 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:48:56.780939 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:56.780939 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:56.780939 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:56.780939 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:48:56.780939 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:48:56.780939 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:48:56.782478 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:48:56.782478 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 00:48:56.782478 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 00:48:56.782478 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 00:48:56.782478 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 00:48:56.782478 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:48:56.782478 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:48:56.782478 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:48:56.782478 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:48:56.782478 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21c2af83-cdf5-43fb-b75e-287be2eb0db7 could not be found. Oct 19 00:48:56.782478 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:48:56.782478 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:56.782478 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:48:56.782478 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:56.782478 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:56.782478 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:56.782478 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:48:56.782478 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:48:56.782478 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21c2af83-cdf5-43fb-b75e-287be2eb0db7 could not be found. Oct 19 00:48:56.782478 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:48:56.784490 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-32d7821b-fc2c-4521-ae20-22e17f4a66cd tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Returning 404 to user: Instance 21c2af83-cdf5-43fb-b75e-287be2eb0db7 could not be found. {{(pid=125532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:48:56.784490 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-32d7821b-fc2c-4521-ae20-22e17f4a66cd tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "DELETE /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7" status: 404 len: 111 microversion: 2.1 time: 0.030273 Oct 19 00:48:56.784490 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 524/1031] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Oct 19 00:48:56 2022] DELETE /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:48:56.790948 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-b45095dc-80a4-451d-9df2-0a406e137ec2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:56.792123 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-b45095dc-80a4-451d-9df2-0a406e137ec2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 21c2af83-cdf5-43fb-b75e-287be2eb0db7] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:56.798787 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b45095dc-80a4-451d-9df2-0a406e137ec2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:56.799284 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b45095dc-80a4-451d-9df2-0a406e137ec2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:56.799718 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b45095dc-80a4-451d-9df2-0a406e137ec2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:56.800493 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b45095dc-80a4-451d-9df2-0a406e137ec2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:56.800947 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b45095dc-80a4-451d-9df2-0a406e137ec2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:56.801366 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b45095dc-80a4-451d-9df2-0a406e137ec2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:56.816669 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.wsgi [None req-b45095dc-80a4-451d-9df2-0a406e137ec2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] HTTP exception thrown: Instance 21c2af83-cdf5-43fb-b75e-287be2eb0db7 could not be found. Oct 19 00:48:56.818213 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-b45095dc-80a4-451d-9df2-0a406e137ec2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Request method failure captured: Oct 19 00:48:56.818213 dv-cinder-master-3-smb devstack@n-api.service[125531]: request: GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 HTTP/1.1 Oct 19 00:48:56.818213 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept: application/json Oct 19 00:48:56.818213 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept-Encoding: identity Oct 19 00:48:56.818213 dv-cinder-master-3-smb devstack@n-api.service[125531]: Connection: close Oct 19 00:48:56.818213 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Length: 0 Oct 19 00:48:56.818213 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Type: application/json Oct 19 00:48:56.818213 dv-cinder-master-3-smb devstack@n-api.service[125531]: Host: 10.222.0.33 Oct 19 00:48:56.818213 dv-cinder-master-3-smb devstack@n-api.service[125531]: Openstack-System-Scope: None Oct 19 00:48:56.818213 dv-cinder-master-3-smb devstack@n-api.service[125531]: User-Agent: python-urllib3/1.26.12 Oct 19 00:48:56.818213 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Auth-Token: gAAAAABjT0dZO9Cl1BpR1E_5nrd-9g_6W01GCmRr-bxs2oosEmvGRcrx0Y-G0IKovE-TfQsuTKO_S4_zWYg0zNU477VxKqXUVmnxsIfPQLMl-kk4S2RGLMvzztHdGHZY35kfzLdr41wbpFPN7pnfATDs8WY4-rnm9WtQvzLBNibrb2MPfqFKqcA Oct 19 00:48:56.818213 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Id: None Oct 19 00:48:56.818213 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Name: None Oct 19 00:48:56.818213 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Identity-Status: Confirmed Oct 19 00:48:56.818213 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Is-Admin-Project: True Oct 19 00:48:56.818213 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Id: default Oct 19 00:48:56.818213 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Name: Default Oct 19 00:48:56.818213 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Id: 4081d4f735b04367a67a03b9539f5432 Oct 19 00:48:56.818213 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Name: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:48:56.818213 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Role: member,reader Oct 19 00:48:56.818213 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Roles: member,reader Oct 19 00:48:56.819586 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4081d4f735b04367a67a03b9539f5432"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:48:56.819586 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:48:56.819586 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Id: 4081d4f735b04367a67a03b9539f5432 Oct 19 00:48:56.819586 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:48:56.819586 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User: tempest-AttachVolumeNegativeTest-339799867-project Oct 19 00:48:56.819586 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Id: default Oct 19 00:48:56.819586 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Name: Default Oct 19 00:48:56.819586 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Id: 5f9a55c605f04f478d0a71679d8bf6a1 Oct 19 00:48:56.819586 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Name: tempest-AttachVolumeNegativeTest-339799867-project Oct 19 00:48:56.819586 dv-cinder-master-3-smb devstack@n-api.service[125531]: method: > Oct 19 00:48:56.819586 dv-cinder-master-3-smb devstack@n-api.service[125531]: exception: Instance 21c2af83-cdf5-43fb-b75e-287be2eb0db7 could not be found. Oct 19 00:48:56.819586 dv-cinder-master-3-smb devstack@n-api.service[125531]: action_args: {'id': '21c2af83-cdf5-43fb-b75e-287be2eb0db7'} Oct 19 00:48:56.820927 dv-cinder-master-3-smb devstack@n-api.service[125531]: {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:48:56.820927 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:56.820927 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:48:56.820927 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:48:56.820927 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:48:56.820927 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:48:56.820927 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:48:56.820927 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:48:56.820927 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:48:56.820927 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:48:56.820927 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21c2af83-cdf5-43fb-b75e-287be2eb0db7 could not be found. Oct 19 00:48:56.820927 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:48:56.820927 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:56.820927 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:48:56.820927 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:56.820927 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:56.820927 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:56.820927 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:48:56.820927 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:48:56.820927 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:48:56.822164 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:48:56.822164 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:48:56.822164 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:48:56.822164 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:48:56.822164 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:48:56.822164 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:48:56.822164 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:48:56.822164 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21c2af83-cdf5-43fb-b75e-287be2eb0db7 could not be found. Oct 19 00:48:56.822164 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:48:56.822164 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:56.822164 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:48:56.822164 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:56.822164 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:56.822164 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:56.822164 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:48:56.822164 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:48:56.822164 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21c2af83-cdf5-43fb-b75e-287be2eb0db7 could not be found. Oct 19 00:48:56.822164 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:48:56.823885 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-b45095dc-80a4-451d-9df2-0a406e137ec2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Returning 404 to user: Instance 21c2af83-cdf5-43fb-b75e-287be2eb0db7 could not be found. {{(pid=125531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:48:56.823885 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-b45095dc-80a4-451d-9df2-0a406e137ec2 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7" status: 404 len: 111 microversion: 2.1 time: 0.032630 Oct 19 00:48:56.823885 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 508/1032] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:56 2022] GET /compute/v2.1/servers/21c2af83-cdf5-43fb-b75e-287be2eb0db7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:48:57.431421 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-3465ef21-2c95-433b-9278-aacbbb10c7d2 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:57.432101 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-3465ef21-2c95-433b-9278-aacbbb10c7d2 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:57.439690 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3465ef21-2c95-433b-9278-aacbbb10c7d2 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:57.440298 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3465ef21-2c95-433b-9278-aacbbb10c7d2 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:57.440668 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3465ef21-2c95-433b-9278-aacbbb10c7d2 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:57.441367 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3465ef21-2c95-433b-9278-aacbbb10c7d2 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:57.441828 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3465ef21-2c95-433b-9278-aacbbb10c7d2 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:57.442251 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-3465ef21-2c95-433b-9278-aacbbb10c7d2 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:57.599390 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-3465ef21-2c95-433b-9278-aacbbb10c7d2 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:57.608341 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-3465ef21-2c95-433b-9278-aacbbb10c7d2 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1518 microversion: 2.1 time: 0.180658 Oct 19 00:48:57.608911 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 525/1033] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:57 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1518 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:57.982050 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-6ff17de1-a142-482f-a325-86f7097477bb tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:57.982619 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-6ff17de1-a142-482f-a325-86f7097477bb tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 361dfd3b-f488-4dac-9511-f28c93f74d37] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:57.989552 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6ff17de1-a142-482f-a325-86f7097477bb tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:57.990201 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6ff17de1-a142-482f-a325-86f7097477bb tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:57.990640 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6ff17de1-a142-482f-a325-86f7097477bb tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:57.991372 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6ff17de1-a142-482f-a325-86f7097477bb tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:57.991819 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6ff17de1-a142-482f-a325-86f7097477bb tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:57.992257 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6ff17de1-a142-482f-a325-86f7097477bb tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:58.007548 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.wsgi [None req-6ff17de1-a142-482f-a325-86f7097477bb tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] HTTP exception thrown: Instance 361dfd3b-f488-4dac-9511-f28c93f74d37 could not be found. Oct 19 00:48:58.009279 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-6ff17de1-a142-482f-a325-86f7097477bb tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Request method failure captured: Oct 19 00:48:58.009279 dv-cinder-master-3-smb devstack@n-api.service[125531]: request: DELETE /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37 HTTP/1.1 Oct 19 00:48:58.009279 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept: application/json Oct 19 00:48:58.009279 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept-Encoding: identity Oct 19 00:48:58.009279 dv-cinder-master-3-smb devstack@n-api.service[125531]: Connection: close Oct 19 00:48:58.009279 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Length: 0 Oct 19 00:48:58.009279 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Type: application/json Oct 19 00:48:58.009279 dv-cinder-master-3-smb devstack@n-api.service[125531]: Host: 10.222.0.33 Oct 19 00:48:58.009279 dv-cinder-master-3-smb devstack@n-api.service[125531]: Openstack-System-Scope: None Oct 19 00:48:58.009279 dv-cinder-master-3-smb devstack@n-api.service[125531]: User-Agent: python-urllib3/1.26.12 Oct 19 00:48:58.009279 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Auth-Token: gAAAAABjT0dZO9Cl1BpR1E_5nrd-9g_6W01GCmRr-bxs2oosEmvGRcrx0Y-G0IKovE-TfQsuTKO_S4_zWYg0zNU477VxKqXUVmnxsIfPQLMl-kk4S2RGLMvzztHdGHZY35kfzLdr41wbpFPN7pnfATDs8WY4-rnm9WtQvzLBNibrb2MPfqFKqcA Oct 19 00:48:58.009279 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Id: None Oct 19 00:48:58.009279 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Name: None Oct 19 00:48:58.009279 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Identity-Status: Confirmed Oct 19 00:48:58.009279 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Is-Admin-Project: True Oct 19 00:48:58.009279 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Id: default Oct 19 00:48:58.009279 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Name: Default Oct 19 00:48:58.009279 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Id: 4081d4f735b04367a67a03b9539f5432 Oct 19 00:48:58.009279 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Name: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:48:58.009279 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Role: member,reader Oct 19 00:48:58.009279 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Roles: member,reader Oct 19 00:48:58.011320 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4081d4f735b04367a67a03b9539f5432"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:48:58.011320 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:48:58.011320 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Id: 4081d4f735b04367a67a03b9539f5432 Oct 19 00:48:58.011320 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:48:58.011320 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User: tempest-AttachVolumeNegativeTest-339799867-project Oct 19 00:48:58.011320 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Id: default Oct 19 00:48:58.011320 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Name: Default Oct 19 00:48:58.011320 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Id: 5f9a55c605f04f478d0a71679d8bf6a1 Oct 19 00:48:58.011320 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Name: tempest-AttachVolumeNegativeTest-339799867-project Oct 19 00:48:58.011320 dv-cinder-master-3-smb devstack@n-api.service[125531]: method: > Oct 19 00:48:58.011320 dv-cinder-master-3-smb devstack@n-api.service[125531]: exception: Instance 361dfd3b-f488-4dac-9511-f28c93f74d37 could not be found. Oct 19 00:48:58.011320 dv-cinder-master-3-smb devstack@n-api.service[125531]: action_args: {'id': '361dfd3b-f488-4dac-9511-f28c93f74d37'} Oct 19 00:48:58.012790 dv-cinder-master-3-smb devstack@n-api.service[125531]: {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:48:58.012790 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:58.012790 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:48:58.012790 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:48:58.012790 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:48:58.012790 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:48:58.012790 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:48:58.012790 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:48:58.012790 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:48:58.012790 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:48:58.012790 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 361dfd3b-f488-4dac-9511-f28c93f74d37 could not be found. Oct 19 00:48:58.012790 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:48:58.012790 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:58.012790 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:48:58.012790 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:58.012790 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:58.012790 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:58.012790 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:48:58.012790 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:48:58.012790 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:48:58.014843 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:48:58.014843 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 00:48:58.014843 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 00:48:58.014843 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 00:48:58.014843 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 00:48:58.014843 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:48:58.014843 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:48:58.014843 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:48:58.014843 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:48:58.014843 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 361dfd3b-f488-4dac-9511-f28c93f74d37 could not be found. Oct 19 00:48:58.014843 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:48:58.014843 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:58.014843 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:48:58.014843 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:58.014843 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:58.014843 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:58.014843 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:48:58.014843 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:48:58.014843 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 361dfd3b-f488-4dac-9511-f28c93f74d37 could not be found. Oct 19 00:48:58.014843 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:48:58.018344 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-6ff17de1-a142-482f-a325-86f7097477bb tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Returning 404 to user: Instance 361dfd3b-f488-4dac-9511-f28c93f74d37 could not be found. {{(pid=125531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:48:58.018344 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-6ff17de1-a142-482f-a325-86f7097477bb tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "DELETE /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37" status: 404 len: 111 microversion: 2.1 time: 0.034179 Oct 19 00:48:58.019418 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 509/1034] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Oct 19 00:48:57 2022] DELETE /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:48:58.025219 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-b27129d2-2c96-4a2e-a1d1-2b3796186f37 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:58.025985 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-b27129d2-2c96-4a2e-a1d1-2b3796186f37 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] [instance: 361dfd3b-f488-4dac-9511-f28c93f74d37] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:58.048334 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b27129d2-2c96-4a2e-a1d1-2b3796186f37 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:58.048837 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b27129d2-2c96-4a2e-a1d1-2b3796186f37 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:58.049274 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b27129d2-2c96-4a2e-a1d1-2b3796186f37 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:58.049984 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b27129d2-2c96-4a2e-a1d1-2b3796186f37 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:58.050537 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b27129d2-2c96-4a2e-a1d1-2b3796186f37 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:58.050964 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-b27129d2-2c96-4a2e-a1d1-2b3796186f37 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:58.065748 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.wsgi [None req-b27129d2-2c96-4a2e-a1d1-2b3796186f37 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] HTTP exception thrown: Instance 361dfd3b-f488-4dac-9511-f28c93f74d37 could not be found. Oct 19 00:48:58.067324 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-b27129d2-2c96-4a2e-a1d1-2b3796186f37 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Request method failure captured: Oct 19 00:48:58.067324 dv-cinder-master-3-smb devstack@n-api.service[125532]: request: GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37 HTTP/1.1 Oct 19 00:48:58.067324 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept: application/json Oct 19 00:48:58.067324 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept-Encoding: identity Oct 19 00:48:58.067324 dv-cinder-master-3-smb devstack@n-api.service[125532]: Connection: close Oct 19 00:48:58.067324 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Length: 0 Oct 19 00:48:58.067324 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Type: application/json Oct 19 00:48:58.067324 dv-cinder-master-3-smb devstack@n-api.service[125532]: Host: 10.222.0.33 Oct 19 00:48:58.067324 dv-cinder-master-3-smb devstack@n-api.service[125532]: Openstack-System-Scope: None Oct 19 00:48:58.067324 dv-cinder-master-3-smb devstack@n-api.service[125532]: User-Agent: python-urllib3/1.26.12 Oct 19 00:48:58.067324 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Auth-Token: gAAAAABjT0dZO9Cl1BpR1E_5nrd-9g_6W01GCmRr-bxs2oosEmvGRcrx0Y-G0IKovE-TfQsuTKO_S4_zWYg0zNU477VxKqXUVmnxsIfPQLMl-kk4S2RGLMvzztHdGHZY35kfzLdr41wbpFPN7pnfATDs8WY4-rnm9WtQvzLBNibrb2MPfqFKqcA Oct 19 00:48:58.067324 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Id: None Oct 19 00:48:58.067324 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Name: None Oct 19 00:48:58.067324 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Identity-Status: Confirmed Oct 19 00:48:58.067324 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Is-Admin-Project: True Oct 19 00:48:58.067324 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Id: default Oct 19 00:48:58.067324 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Name: Default Oct 19 00:48:58.067324 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Id: 4081d4f735b04367a67a03b9539f5432 Oct 19 00:48:58.067324 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Name: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:48:58.067324 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Role: member,reader Oct 19 00:48:58.067324 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Roles: member,reader Oct 19 00:48:58.068748 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4081d4f735b04367a67a03b9539f5432"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4081d4f735b04367a67a03b9539f5432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:48:58.068748 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:48:58.068748 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Id: 4081d4f735b04367a67a03b9539f5432 Oct 19 00:48:58.068748 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-339799867 Oct 19 00:48:58.068748 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User: tempest-AttachVolumeNegativeTest-339799867-project Oct 19 00:48:58.068748 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Id: default Oct 19 00:48:58.068748 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Name: Default Oct 19 00:48:58.068748 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Id: 5f9a55c605f04f478d0a71679d8bf6a1 Oct 19 00:48:58.068748 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Name: tempest-AttachVolumeNegativeTest-339799867-project Oct 19 00:48:58.068748 dv-cinder-master-3-smb devstack@n-api.service[125532]: method: > Oct 19 00:48:58.068748 dv-cinder-master-3-smb devstack@n-api.service[125532]: exception: Instance 361dfd3b-f488-4dac-9511-f28c93f74d37 could not be found. Oct 19 00:48:58.068748 dv-cinder-master-3-smb devstack@n-api.service[125532]: action_args: {'id': '361dfd3b-f488-4dac-9511-f28c93f74d37'} Oct 19 00:48:58.069536 dv-cinder-master-3-smb devstack@n-api.service[125532]: {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:48:58.069536 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:58.069536 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:48:58.069536 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:48:58.069536 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:48:58.069536 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:48:58.069536 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:48:58.069536 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:48:58.069536 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:48:58.069536 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:48:58.069536 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 361dfd3b-f488-4dac-9511-f28c93f74d37 could not be found. Oct 19 00:48:58.069536 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:48:58.069536 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:58.069536 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:48:58.069536 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:58.069536 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:58.069536 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:58.069536 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:48:58.069536 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:48:58.069536 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:48:58.070818 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:48:58.070818 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:48:58.070818 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:48:58.070818 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:48:58.070818 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:48:58.070818 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:48:58.070818 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:48:58.070818 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 361dfd3b-f488-4dac-9511-f28c93f74d37 could not be found. Oct 19 00:48:58.070818 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:48:58.070818 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:58.070818 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:48:58.070818 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:58.070818 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:58.070818 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:58.070818 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:48:58.070818 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:48:58.070818 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 361dfd3b-f488-4dac-9511-f28c93f74d37 could not be found. Oct 19 00:48:58.070818 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:48:58.074846 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-b27129d2-2c96-4a2e-a1d1-2b3796186f37 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] Returning 404 to user: Instance 361dfd3b-f488-4dac-9511-f28c93f74d37 could not be found. {{(pid=125532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:48:58.074846 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-b27129d2-2c96-4a2e-a1d1-2b3796186f37 tempest-AttachVolumeNegativeTest-339799867 tempest-AttachVolumeNegativeTest-339799867-project] 10.222.0.33 "GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37" status: 404 len: 111 microversion: 2.1 time: 0.048522 Oct 19 00:48:58.074846 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 526/1035] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:58 2022] GET /compute/v2.1/servers/361dfd3b-f488-4dac-9511-f28c93f74d37 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 00:48:58.632357 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-5c262923-910a-4aff-ae5e-96367b11c29b tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:58.632971 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-5c262923-910a-4aff-ae5e-96367b11c29b tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:58.639411 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5c262923-910a-4aff-ae5e-96367b11c29b tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:58.639945 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5c262923-910a-4aff-ae5e-96367b11c29b tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:58.640391 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5c262923-910a-4aff-ae5e-96367b11c29b tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:58.641092 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5c262923-910a-4aff-ae5e-96367b11c29b tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:58.661971 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5c262923-910a-4aff-ae5e-96367b11c29b tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:58.662653 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-5c262923-910a-4aff-ae5e-96367b11c29b tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:58.870560 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-5c262923-910a-4aff-ae5e-96367b11c29b tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:58.878785 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-5c262923-910a-4aff-ae5e-96367b11c29b tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1574 microversion: 2.1 time: 0.250213 Oct 19 00:48:58.879352 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 510/1036] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:58 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1574 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:59.903680 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-f38c629c-b6d5-4564-bbb9-ac02e5c46ce6 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:59.904332 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-f38c629c-b6d5-4564-bbb9-ac02e5c46ce6 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:59.911066 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f38c629c-b6d5-4564-bbb9-ac02e5c46ce6 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:59.911843 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f38c629c-b6d5-4564-bbb9-ac02e5c46ce6 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:59.912483 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f38c629c-b6d5-4564-bbb9-ac02e5c46ce6 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:59.913365 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f38c629c-b6d5-4564-bbb9-ac02e5c46ce6 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:59.913976 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f38c629c-b6d5-4564-bbb9-ac02e5c46ce6 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:59.914547 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-f38c629c-b6d5-4564-bbb9-ac02e5c46ce6 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:00.140033 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-f38c629c-b6d5-4564-bbb9-ac02e5c46ce6 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:00.156023 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-f38c629c-b6d5-4564-bbb9-ac02e5c46ce6 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1574 microversion: 2.1 time: 0.257114 Oct 19 00:49:00.164711 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 527/1037] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:59 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1574 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:00.203594 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-09842699-b5fe-4f3d-932b-2fb913a9d044 req-9d86d3d0-e4f7-4b7a-b847-b0906850c532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a4f60d9-b884-40cb-a416-b34e456f77e9", "name": "network-vif-unplugged", "status": "completed", "tag": "8d31d467-6029-44f7-b3e8-25183019299e"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:00.219811 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-09842699-b5fe-4f3d-932b-2fb913a9d044 req-9d86d3d0-e4f7-4b7a-b847-b0906850c532 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:00.220824 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-09842699-b5fe-4f3d-932b-2fb913a9d044 req-9d86d3d0-e4f7-4b7a-b847-b0906850c532 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:00.221549 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-09842699-b5fe-4f3d-932b-2fb913a9d044 req-9d86d3d0-e4f7-4b7a-b847-b0906850c532 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:00.237536 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-09842699-b5fe-4f3d-932b-2fb913a9d044 req-9d86d3d0-e4f7-4b7a-b847-b0906850c532 service nova] Creating event network-vif-unplugged:8d31d467-6029-44f7-b3e8-25183019299e for instance 6a4f60d9-b884-40cb-a416-b34e456f77e9 on hv-cinder-maste Oct 19 00:49:00.244543 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-09842699-b5fe-4f3d-932b-2fb913a9d044 req-9d86d3d0-e4f7-4b7a-b847-b0906850c532 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049561 Oct 19 00:49:00.247103 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 511/1038] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:01.188416 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-c007b9ea-6643-42b5-9e01-f32833fe4b01 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:01.189041 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-c007b9ea-6643-42b5-9e01-f32833fe4b01 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:01.202450 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c007b9ea-6643-42b5-9e01-f32833fe4b01 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:01.204257 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c007b9ea-6643-42b5-9e01-f32833fe4b01 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:01.206877 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c007b9ea-6643-42b5-9e01-f32833fe4b01 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:01.207727 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c007b9ea-6643-42b5-9e01-f32833fe4b01 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:01.208412 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c007b9ea-6643-42b5-9e01-f32833fe4b01 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:01.212907 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c007b9ea-6643-42b5-9e01-f32833fe4b01 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:01.388533 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-c007b9ea-6643-42b5-9e01-f32833fe4b01 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:01.396433 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-c007b9ea-6643-42b5-9e01-f32833fe4b01 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1574 microversion: 2.1 time: 0.213061 Oct 19 00:49:01.397006 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 528/1039] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:01 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1574 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:02.424694 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-e505f3d5-cbc9-4826-8d03-f4f5dfbc912d tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:02.425417 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-e505f3d5-cbc9-4826-8d03-f4f5dfbc912d tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:02.432587 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e505f3d5-cbc9-4826-8d03-f4f5dfbc912d tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:02.433227 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e505f3d5-cbc9-4826-8d03-f4f5dfbc912d tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:02.433858 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e505f3d5-cbc9-4826-8d03-f4f5dfbc912d tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:02.434605 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e505f3d5-cbc9-4826-8d03-f4f5dfbc912d tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:02.435063 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e505f3d5-cbc9-4826-8d03-f4f5dfbc912d tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:02.435488 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e505f3d5-cbc9-4826-8d03-f4f5dfbc912d tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:02.604626 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-e505f3d5-cbc9-4826-8d03-f4f5dfbc912d tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:02.613059 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-e505f3d5-cbc9-4826-8d03-f4f5dfbc912d tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1574 microversion: 2.1 time: 0.196491 Oct 19 00:49:02.613858 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 512/1040] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:02 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1574 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:03.638315 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-24118993-e45c-447f-8044-8f26b3cfc720 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:03.639620 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-24118993-e45c-447f-8044-8f26b3cfc720 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:03.648008 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-24118993-e45c-447f-8044-8f26b3cfc720 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:03.648828 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-24118993-e45c-447f-8044-8f26b3cfc720 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:03.649510 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-24118993-e45c-447f-8044-8f26b3cfc720 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:03.650437 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-24118993-e45c-447f-8044-8f26b3cfc720 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:03.651204 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-24118993-e45c-447f-8044-8f26b3cfc720 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:03.651868 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-24118993-e45c-447f-8044-8f26b3cfc720 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:03.809640 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-24118993-e45c-447f-8044-8f26b3cfc720 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:03.819557 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-24118993-e45c-447f-8044-8f26b3cfc720 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1561 microversion: 2.1 time: 0.185214 Oct 19 00:49:03.820351 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 529/1041] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:03 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1561 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:04.209558 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-e2ef39c9-c439-4d5c-b349-c611318b4b5a req-24113ee6-1bdb-4c73-a2ec-b6f936e2745b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a4f60d9-b884-40cb-a416-b34e456f77e9", "name": "network-vif-plugged", "status": "completed", "tag": "8d31d467-6029-44f7-b3e8-25183019299e"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:04.220142 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-e2ef39c9-c439-4d5c-b349-c611318b4b5a req-24113ee6-1bdb-4c73-a2ec-b6f936e2745b service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:04.221000 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-e2ef39c9-c439-4d5c-b349-c611318b4b5a req-24113ee6-1bdb-4c73-a2ec-b6f936e2745b service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:04.221607 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-e2ef39c9-c439-4d5c-b349-c611318b4b5a req-24113ee6-1bdb-4c73-a2ec-b6f936e2745b service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:04.236082 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-e2ef39c9-c439-4d5c-b349-c611318b4b5a req-24113ee6-1bdb-4c73-a2ec-b6f936e2745b service nova] Creating event network-vif-plugged:8d31d467-6029-44f7-b3e8-25183019299e for instance 6a4f60d9-b884-40cb-a416-b34e456f77e9 on hv-cinder-maste Oct 19 00:49:04.241597 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-e2ef39c9-c439-4d5c-b349-c611318b4b5a req-24113ee6-1bdb-4c73-a2ec-b6f936e2745b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035529 Oct 19 00:49:04.242746 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 513/1042] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:05.155998 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-221907b2-7890-425f-9962-3d03f3a706d8 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:05.158955 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-221907b2-7890-425f-9962-3d03f3a706d8 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:05.165738 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-221907b2-7890-425f-9962-3d03f3a706d8 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:05.167021 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-221907b2-7890-425f-9962-3d03f3a706d8 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:05.167640 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-221907b2-7890-425f-9962-3d03f3a706d8 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:05.168657 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-221907b2-7890-425f-9962-3d03f3a706d8 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:05.169260 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-221907b2-7890-425f-9962-3d03f3a706d8 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:05.169830 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-221907b2-7890-425f-9962-3d03f3a706d8 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:05.201649 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-221907b2-7890-425f-9962-3d03f3a706d8 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049529 Oct 19 00:49:05.202568 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 530/1043] 10.222.0.33 () {60 vars in 1343 bytes} [Wed Oct 19 00:49:05 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:05.275028 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-d9c91b0c-64e1-45c9-b6f5-c5bafdc5c28d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:05.275648 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-d9c91b0c-64e1-45c9-b6f5-c5bafdc5c28d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:05.283654 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d9c91b0c-64e1-45c9-b6f5-c5bafdc5c28d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:05.284172 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d9c91b0c-64e1-45c9-b6f5-c5bafdc5c28d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:05.284616 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d9c91b0c-64e1-45c9-b6f5-c5bafdc5c28d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:05.285323 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d9c91b0c-64e1-45c9-b6f5-c5bafdc5c28d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:05.285802 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d9c91b0c-64e1-45c9-b6f5-c5bafdc5c28d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:05.286231 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d9c91b0c-64e1-45c9-b6f5-c5bafdc5c28d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:05.319421 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-d9c91b0c-64e1-45c9-b6f5-c5bafdc5c28d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Going to try to terminate instance {{(pid=125531) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:49:05.401955 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-d9c91b0c-64e1-45c9-b6f5-c5bafdc5c28d tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 204 len: 0 microversion: 2.20 time: 0.130606 Oct 19 00:49:05.402944 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 514/1044] 10.222.0.33 () {60 vars in 1280 bytes} [Wed Oct 19 00:49:05 2022] DELETE /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 00:49:05.411368 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-a6d22306-f316-42c2-a648-226f79b1d338 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:05.412013 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-a6d22306-f316-42c2-a648-226f79b1d338 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:05.418129 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a6d22306-f316-42c2-a648-226f79b1d338 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:05.418614 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a6d22306-f316-42c2-a648-226f79b1d338 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:05.419046 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a6d22306-f316-42c2-a648-226f79b1d338 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:05.419757 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a6d22306-f316-42c2-a648-226f79b1d338 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:05.420230 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a6d22306-f316-42c2-a648-226f79b1d338 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:05.420658 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-a6d22306-f316-42c2-a648-226f79b1d338 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:05.711691 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-a6d22306-f316-42c2-a648-226f79b1d338 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:05.715793 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:05.722272 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-a6d22306-f316-42c2-a648-226f79b1d338 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:05.723722 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-a6d22306-f316-42c2-a648-226f79b1d338 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:05.725123 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-a6d22306-f316-42c2-a648-226f79b1d338 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1722 microversion: 2.20 time: 0.317754 Oct 19 00:49:05.729251 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 531/1045] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:49:05 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1722 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:49:06.758005 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-874f7ee4-67fa-4032-990b-0d20e8fa0f3f tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:06.762146 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-874f7ee4-67fa-4032-990b-0d20e8fa0f3f tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:06.775296 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-874f7ee4-67fa-4032-990b-0d20e8fa0f3f tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:06.775487 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-874f7ee4-67fa-4032-990b-0d20e8fa0f3f tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:06.776059 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-874f7ee4-67fa-4032-990b-0d20e8fa0f3f tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:06.776933 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-874f7ee4-67fa-4032-990b-0d20e8fa0f3f tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:06.777442 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-874f7ee4-67fa-4032-990b-0d20e8fa0f3f tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:06.777859 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-874f7ee4-67fa-4032-990b-0d20e8fa0f3f tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:06.952171 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-874f7ee4-67fa-4032-990b-0d20e8fa0f3f tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:06.965337 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-874f7ee4-67fa-4032-990b-0d20e8fa0f3f tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:06.966899 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-874f7ee4-67fa-4032-990b-0d20e8fa0f3f tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:06.968167 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-874f7ee4-67fa-4032-990b-0d20e8fa0f3f tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1722 microversion: 2.20 time: 0.217223 Oct 19 00:49:06.969067 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 515/1046] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:49:06 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:49:07.971085 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-cf23b959-c40e-43b1-a4e6-b7b7ccf5806b req-7a4cd4ba-09bb-4e51-a077-f42243bc4028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a48c163-1acb-4ff4-8f2e-b6b529707da4", "name": "network-vif-deleted", "tag": "3fc16ed1-ad15-4f2c-8cb0-7877e83842ab"}]} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:07.997912 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-14d91112-cebb-49ba-b563-a15db276eca4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:07.997912 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-14d91112-cebb-49ba-b563-a15db276eca4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:07.998455 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-cf23b959-c40e-43b1-a4e6-b7b7ccf5806b req-7a4cd4ba-09bb-4e51-a077-f42243bc4028 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:07.998455 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-cf23b959-c40e-43b1-a4e6-b7b7ccf5806b req-7a4cd4ba-09bb-4e51-a077-f42243bc4028 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:07.998664 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-cf23b959-c40e-43b1-a4e6-b7b7ccf5806b req-7a4cd4ba-09bb-4e51-a077-f42243bc4028 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:08.006448 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-14d91112-cebb-49ba-b563-a15db276eca4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:08.006940 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-14d91112-cebb-49ba-b563-a15db276eca4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:08.007385 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-14d91112-cebb-49ba-b563-a15db276eca4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:08.011904 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-14d91112-cebb-49ba-b563-a15db276eca4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:08.012814 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-14d91112-cebb-49ba-b563-a15db276eca4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:08.013309 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-14d91112-cebb-49ba-b563-a15db276eca4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:08.028585 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.compute.server_external_events [req-cf23b959-c40e-43b1-a4e6-b7b7ccf5806b req-7a4cd4ba-09bb-4e51-a077-f42243bc4028 service nova] Creating event network-vif-deleted:3fc16ed1-ad15-4f2c-8cb0-7877e83842ab for instance 7a48c163-1acb-4ff4-8f2e-b6b529707da4 on hv-cinder-maste Oct 19 00:49:08.035143 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-cf23b959-c40e-43b1-a4e6-b7b7ccf5806b req-7a4cd4ba-09bb-4e51-a077-f42243bc4028 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068954 Oct 19 00:49:08.036342 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 532/1047] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:08.115188 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-14d91112-cebb-49ba-b563-a15db276eca4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:08.133769 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-14d91112-cebb-49ba-b563-a15db276eca4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:08.135259 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-14d91112-cebb-49ba-b563-a15db276eca4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59bad833caf84817b8553d699b2fa04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e171056a4354ca695c18f115bfb750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:08.136913 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-14d91112-cebb-49ba-b563-a15db276eca4 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 200 len: 1366 microversion: 2.20 time: 0.146917 Oct 19 00:49:08.137666 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 516/1048] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:49:07 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:49:09.164125 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-e0c21710-cbc5-4810-b61e-9964c19a71e2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:09.164886 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-e0c21710-cbc5-4810-b61e-9964c19a71e2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:09.172572 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e0c21710-cbc5-4810-b61e-9964c19a71e2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:09.173033 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e0c21710-cbc5-4810-b61e-9964c19a71e2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:09.173473 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e0c21710-cbc5-4810-b61e-9964c19a71e2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:09.174236 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e0c21710-cbc5-4810-b61e-9964c19a71e2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:09.174744 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e0c21710-cbc5-4810-b61e-9964c19a71e2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:09.175246 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-e0c21710-cbc5-4810-b61e-9964c19a71e2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:09.198706 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.wsgi [None req-e0c21710-cbc5-4810-b61e-9964c19a71e2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] HTTP exception thrown: Instance 7a48c163-1acb-4ff4-8f2e-b6b529707da4 could not be found. Oct 19 00:49:09.200428 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-e0c21710-cbc5-4810-b61e-9964c19a71e2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Request method failure captured: Oct 19 00:49:09.200428 dv-cinder-master-3-smb devstack@n-api.service[125532]: request: GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 HTTP/1.1 Oct 19 00:49:09.200428 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept: application/json Oct 19 00:49:09.200428 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept-Encoding: identity Oct 19 00:49:09.200428 dv-cinder-master-3-smb devstack@n-api.service[125532]: Connection: close Oct 19 00:49:09.200428 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Length: 0 Oct 19 00:49:09.200428 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Type: application/json Oct 19 00:49:09.200428 dv-cinder-master-3-smb devstack@n-api.service[125532]: Host: 10.222.0.33 Oct 19 00:49:09.200428 dv-cinder-master-3-smb devstack@n-api.service[125532]: Openstack-System-Scope: None Oct 19 00:49:09.200428 dv-cinder-master-3-smb devstack@n-api.service[125532]: User-Agent: python-urllib3/1.26.12 Oct 19 00:49:09.200428 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Auth-Token: gAAAAABjT0dURaQ0HkRLJEsGfzC_hRt4QN5ysEIaY_BdQncL37G8-e-M3ZjfrgebU4tcOIRdKUHJ-8z0aMZ640IHN49nGivJqqNyX0ZANulCJEroSNvpy7R_0fS2-vNh5ZgaMp1tnHwZD8YVTbC5bIUu683iJQuGIijDZuo9O89CoiTmfOhMdZY Oct 19 00:49:09.200428 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Id: None Oct 19 00:49:09.200428 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Name: None Oct 19 00:49:09.200428 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Identity-Status: Confirmed Oct 19 00:49:09.200428 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Is-Admin-Project: True Oct 19 00:49:09.200428 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 00:49:09.200428 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Id: default Oct 19 00:49:09.200428 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Name: Default Oct 19 00:49:09.200428 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Id: 5e171056a4354ca695c18f115bfb750f Oct 19 00:49:09.200428 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-150806215 Oct 19 00:49:09.200428 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Role: member,reader Oct 19 00:49:09.200428 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Roles: member,reader Oct 19 00:49:09.202042 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5e171056a4354ca695c18f115bfb750f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5e171056a4354ca695c18f115bfb750f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5e171056a4354ca695c18f115bfb750f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5e171056a4354ca695c18f115bfb750f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:49:09.202042 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant: tempest-AttachVolumeShelveTestJSON-150806215 Oct 19 00:49:09.202042 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Id: 5e171056a4354ca695c18f115bfb750f Oct 19 00:49:09.202042 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-150806215 Oct 19 00:49:09.202042 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User: tempest-AttachVolumeShelveTestJSON-150806215-project Oct 19 00:49:09.202042 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Id: default Oct 19 00:49:09.202042 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Name: Default Oct 19 00:49:09.202042 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Id: 59bad833caf84817b8553d699b2fa04f Oct 19 00:49:09.202042 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Name: tempest-AttachVolumeShelveTestJSON-150806215-project Oct 19 00:49:09.202042 dv-cinder-master-3-smb devstack@n-api.service[125532]: method: > Oct 19 00:49:09.202042 dv-cinder-master-3-smb devstack@n-api.service[125532]: exception: Instance 7a48c163-1acb-4ff4-8f2e-b6b529707da4 could not be found. Oct 19 00:49:09.202042 dv-cinder-master-3-smb devstack@n-api.service[125532]: action_args: {'id': '7a48c163-1acb-4ff4-8f2e-b6b529707da4'} Oct 19 00:49:09.202926 dv-cinder-master-3-smb devstack@n-api.service[125532]: {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:49:09.202926 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:09.202926 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:49:09.202926 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:49:09.202926 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:49:09.202926 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:49:09.202926 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:49:09.202926 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:49:09.202926 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:49:09.202926 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:49:09.202926 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a48c163-1acb-4ff4-8f2e-b6b529707da4 could not be found. Oct 19 00:49:09.202926 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:49:09.202926 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:49:09.202926 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:49:09.202926 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:09.202926 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:49:09.202926 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:49:09.202926 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:49:09.202926 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:49:09.202926 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:49:09.204304 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:49:09.204304 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:49:09.204304 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:49:09.204304 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:49:09.204304 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:49:09.204304 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:49:09.204304 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:49:09.204304 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a48c163-1acb-4ff4-8f2e-b6b529707da4 could not be found. Oct 19 00:49:09.204304 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:49:09.204304 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:49:09.204304 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:49:09.204304 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:09.204304 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:49:09.204304 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:49:09.204304 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:49:09.204304 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:49:09.204304 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a48c163-1acb-4ff4-8f2e-b6b529707da4 could not be found. Oct 19 00:49:09.204304 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:49:09.205489 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-e0c21710-cbc5-4810-b61e-9964c19a71e2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Returning 404 to user: Instance 7a48c163-1acb-4ff4-8f2e-b6b529707da4 could not be found. {{(pid=125532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:49:09.205489 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-e0c21710-cbc5-4810-b61e-9964c19a71e2 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 404 len: 111 microversion: 2.20 time: 0.042748 Oct 19 00:49:09.205489 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 533/1049] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:49:09 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:49:09.217100 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-5e54d5d7-9eef-4a37-bb9b-d8cd06323a3a tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '.version_select at 0x7f81f11408b0>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:09.237040 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-5e54d5d7-9eef-4a37-bb9b-d8cd06323a3a tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-796050227" status: 204 len: 0 microversion: 2.20 time: 0.029150 Oct 19 00:49:09.238084 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 517/1050] 10.222.0.33 () {60 vars in 1259 bytes} [Wed Oct 19 00:49:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-796050227 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 00:49:11.042375 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-c7bde523-0175-45a6-8197-fe3242bb6e52 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:11.042375 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-c7bde523-0175-45a6-8197-fe3242bb6e52 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:11.049476 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c7bde523-0175-45a6-8197-fe3242bb6e52 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:11.049958 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c7bde523-0175-45a6-8197-fe3242bb6e52 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:11.050393 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c7bde523-0175-45a6-8197-fe3242bb6e52 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:11.051124 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c7bde523-0175-45a6-8197-fe3242bb6e52 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:11.051579 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c7bde523-0175-45a6-8197-fe3242bb6e52 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:11.052037 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c7bde523-0175-45a6-8197-fe3242bb6e52 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:11.065800 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.wsgi [None req-c7bde523-0175-45a6-8197-fe3242bb6e52 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] HTTP exception thrown: Instance 7a48c163-1acb-4ff4-8f2e-b6b529707da4 could not be found. Oct 19 00:49:11.067367 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-c7bde523-0175-45a6-8197-fe3242bb6e52 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Request method failure captured: Oct 19 00:49:11.067367 dv-cinder-master-3-smb devstack@n-api.service[125532]: request: DELETE /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 HTTP/1.1 Oct 19 00:49:11.067367 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept: application/json Oct 19 00:49:11.067367 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept-Encoding: identity Oct 19 00:49:11.067367 dv-cinder-master-3-smb devstack@n-api.service[125532]: Connection: close Oct 19 00:49:11.067367 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Length: 0 Oct 19 00:49:11.067367 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Type: application/json Oct 19 00:49:11.067367 dv-cinder-master-3-smb devstack@n-api.service[125532]: Host: 10.222.0.33 Oct 19 00:49:11.067367 dv-cinder-master-3-smb devstack@n-api.service[125532]: Openstack-System-Scope: None Oct 19 00:49:11.067367 dv-cinder-master-3-smb devstack@n-api.service[125532]: User-Agent: python-urllib3/1.26.12 Oct 19 00:49:11.067367 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Auth-Token: gAAAAABjT0dURaQ0HkRLJEsGfzC_hRt4QN5ysEIaY_BdQncL37G8-e-M3ZjfrgebU4tcOIRdKUHJ-8z0aMZ640IHN49nGivJqqNyX0ZANulCJEroSNvpy7R_0fS2-vNh5ZgaMp1tnHwZD8YVTbC5bIUu683iJQuGIijDZuo9O89CoiTmfOhMdZY Oct 19 00:49:11.067367 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Id: None Oct 19 00:49:11.067367 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Name: None Oct 19 00:49:11.067367 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Identity-Status: Confirmed Oct 19 00:49:11.067367 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Is-Admin-Project: True Oct 19 00:49:11.067367 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 00:49:11.067367 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Id: default Oct 19 00:49:11.067367 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Name: Default Oct 19 00:49:11.067367 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Id: 5e171056a4354ca695c18f115bfb750f Oct 19 00:49:11.067367 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-150806215 Oct 19 00:49:11.067367 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Role: member,reader Oct 19 00:49:11.067367 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Roles: member,reader Oct 19 00:49:11.068908 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5e171056a4354ca695c18f115bfb750f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5e171056a4354ca695c18f115bfb750f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5e171056a4354ca695c18f115bfb750f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5e171056a4354ca695c18f115bfb750f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:49:11.068908 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant: tempest-AttachVolumeShelveTestJSON-150806215 Oct 19 00:49:11.068908 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Id: 5e171056a4354ca695c18f115bfb750f Oct 19 00:49:11.068908 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-150806215 Oct 19 00:49:11.068908 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User: tempest-AttachVolumeShelveTestJSON-150806215-project Oct 19 00:49:11.068908 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Id: default Oct 19 00:49:11.068908 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Name: Default Oct 19 00:49:11.068908 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Id: 59bad833caf84817b8553d699b2fa04f Oct 19 00:49:11.068908 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Name: tempest-AttachVolumeShelveTestJSON-150806215-project Oct 19 00:49:11.068908 dv-cinder-master-3-smb devstack@n-api.service[125532]: method: > Oct 19 00:49:11.068908 dv-cinder-master-3-smb devstack@n-api.service[125532]: exception: Instance 7a48c163-1acb-4ff4-8f2e-b6b529707da4 could not be found. Oct 19 00:49:11.068908 dv-cinder-master-3-smb devstack@n-api.service[125532]: action_args: {'id': '7a48c163-1acb-4ff4-8f2e-b6b529707da4'} Oct 19 00:49:11.069827 dv-cinder-master-3-smb devstack@n-api.service[125532]: {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:49:11.069827 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:11.069827 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:49:11.069827 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:49:11.069827 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:49:11.069827 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:49:11.069827 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:49:11.069827 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:49:11.069827 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:49:11.069827 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:49:11.069827 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a48c163-1acb-4ff4-8f2e-b6b529707da4 could not be found. Oct 19 00:49:11.069827 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:49:11.069827 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:49:11.069827 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:49:11.069827 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:11.069827 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:49:11.069827 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:49:11.069827 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:49:11.069827 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:49:11.069827 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:49:11.071426 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:49:11.071426 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 00:49:11.071426 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 00:49:11.071426 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 00:49:11.071426 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 00:49:11.071426 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:49:11.071426 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:49:11.071426 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:49:11.071426 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:49:11.071426 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a48c163-1acb-4ff4-8f2e-b6b529707da4 could not be found. Oct 19 00:49:11.071426 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:49:11.071426 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:49:11.071426 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:49:11.071426 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:11.071426 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:49:11.071426 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:49:11.071426 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:49:11.071426 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:49:11.071426 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a48c163-1acb-4ff4-8f2e-b6b529707da4 could not be found. Oct 19 00:49:11.071426 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:49:11.074163 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-c7bde523-0175-45a6-8197-fe3242bb6e52 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Returning 404 to user: Instance 7a48c163-1acb-4ff4-8f2e-b6b529707da4 could not be found. {{(pid=125532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:49:11.074163 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-c7bde523-0175-45a6-8197-fe3242bb6e52 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 404 len: 111 microversion: 2.20 time: 0.030818 Oct 19 00:49:11.074163 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 534/1051] 10.222.0.33 () {60 vars in 1280 bytes} [Wed Oct 19 00:49:11 2022] DELETE /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:49:11.078503 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-6989137c-fd36-43f5-8200-cfa72a0eb80b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:11.079114 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-6989137c-fd36-43f5-8200-cfa72a0eb80b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 7a48c163-1acb-4ff4-8f2e-b6b529707da4] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:11.085948 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6989137c-fd36-43f5-8200-cfa72a0eb80b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:11.086430 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6989137c-fd36-43f5-8200-cfa72a0eb80b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:11.086867 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6989137c-fd36-43f5-8200-cfa72a0eb80b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:11.087557 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6989137c-fd36-43f5-8200-cfa72a0eb80b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:11.088050 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6989137c-fd36-43f5-8200-cfa72a0eb80b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:11.089145 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6989137c-fd36-43f5-8200-cfa72a0eb80b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:11.102993 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.wsgi [None req-6989137c-fd36-43f5-8200-cfa72a0eb80b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] HTTP exception thrown: Instance 7a48c163-1acb-4ff4-8f2e-b6b529707da4 could not be found. Oct 19 00:49:11.104960 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-6989137c-fd36-43f5-8200-cfa72a0eb80b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Request method failure captured: Oct 19 00:49:11.104960 dv-cinder-master-3-smb devstack@n-api.service[125531]: request: GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 HTTP/1.1 Oct 19 00:49:11.104960 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept: application/json Oct 19 00:49:11.104960 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept-Encoding: identity Oct 19 00:49:11.104960 dv-cinder-master-3-smb devstack@n-api.service[125531]: Connection: close Oct 19 00:49:11.104960 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Length: 0 Oct 19 00:49:11.104960 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Type: application/json Oct 19 00:49:11.104960 dv-cinder-master-3-smb devstack@n-api.service[125531]: Host: 10.222.0.33 Oct 19 00:49:11.104960 dv-cinder-master-3-smb devstack@n-api.service[125531]: Openstack-System-Scope: None Oct 19 00:49:11.104960 dv-cinder-master-3-smb devstack@n-api.service[125531]: User-Agent: python-urllib3/1.26.12 Oct 19 00:49:11.104960 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Auth-Token: gAAAAABjT0dURaQ0HkRLJEsGfzC_hRt4QN5ysEIaY_BdQncL37G8-e-M3ZjfrgebU4tcOIRdKUHJ-8z0aMZ640IHN49nGivJqqNyX0ZANulCJEroSNvpy7R_0fS2-vNh5ZgaMp1tnHwZD8YVTbC5bIUu683iJQuGIijDZuo9O89CoiTmfOhMdZY Oct 19 00:49:11.104960 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Id: None Oct 19 00:49:11.104960 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Name: None Oct 19 00:49:11.104960 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Identity-Status: Confirmed Oct 19 00:49:11.104960 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Is-Admin-Project: True Oct 19 00:49:11.104960 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 00:49:11.104960 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Id: default Oct 19 00:49:11.104960 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Name: Default Oct 19 00:49:11.104960 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Id: 5e171056a4354ca695c18f115bfb750f Oct 19 00:49:11.104960 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-150806215 Oct 19 00:49:11.104960 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Role: member,reader Oct 19 00:49:11.104960 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Roles: member,reader Oct 19 00:49:11.106674 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5e171056a4354ca695c18f115bfb750f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5e171056a4354ca695c18f115bfb750f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5e171056a4354ca695c18f115bfb750f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5e171056a4354ca695c18f115bfb750f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:49:11.106674 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant: tempest-AttachVolumeShelveTestJSON-150806215 Oct 19 00:49:11.106674 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Id: 5e171056a4354ca695c18f115bfb750f Oct 19 00:49:11.106674 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-150806215 Oct 19 00:49:11.106674 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User: tempest-AttachVolumeShelveTestJSON-150806215-project Oct 19 00:49:11.106674 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Id: default Oct 19 00:49:11.106674 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Name: Default Oct 19 00:49:11.106674 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Id: 59bad833caf84817b8553d699b2fa04f Oct 19 00:49:11.106674 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Name: tempest-AttachVolumeShelveTestJSON-150806215-project Oct 19 00:49:11.106674 dv-cinder-master-3-smb devstack@n-api.service[125531]: method: > Oct 19 00:49:11.106674 dv-cinder-master-3-smb devstack@n-api.service[125531]: exception: Instance 7a48c163-1acb-4ff4-8f2e-b6b529707da4 could not be found. Oct 19 00:49:11.106674 dv-cinder-master-3-smb devstack@n-api.service[125531]: action_args: {'id': '7a48c163-1acb-4ff4-8f2e-b6b529707da4'} Oct 19 00:49:11.107488 dv-cinder-master-3-smb devstack@n-api.service[125531]: {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:49:11.107488 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:11.107488 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:49:11.107488 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:49:11.107488 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:49:11.107488 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:49:11.107488 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:49:11.107488 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:49:11.107488 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:49:11.107488 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:49:11.107488 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a48c163-1acb-4ff4-8f2e-b6b529707da4 could not be found. Oct 19 00:49:11.107488 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:49:11.107488 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:49:11.107488 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:49:11.107488 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:11.107488 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:49:11.107488 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:49:11.107488 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:49:11.107488 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:49:11.107488 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:49:11.108812 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:49:11.108812 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:49:11.108812 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:49:11.108812 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:49:11.108812 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:49:11.108812 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:49:11.108812 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:49:11.108812 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a48c163-1acb-4ff4-8f2e-b6b529707da4 could not be found. Oct 19 00:49:11.108812 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:49:11.108812 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:49:11.108812 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:49:11.108812 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:11.108812 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:49:11.108812 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:49:11.108812 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:49:11.108812 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:49:11.108812 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a48c163-1acb-4ff4-8f2e-b6b529707da4 could not be found. Oct 19 00:49:11.108812 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:49:11.109919 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-6989137c-fd36-43f5-8200-cfa72a0eb80b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Returning 404 to user: Instance 7a48c163-1acb-4ff4-8f2e-b6b529707da4 could not be found. {{(pid=125531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:49:11.109919 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-6989137c-fd36-43f5-8200-cfa72a0eb80b tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4" status: 404 len: 111 microversion: 2.20 time: 0.032172 Oct 19 00:49:11.109919 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 518/1052] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:49:11 2022] GET /compute/v2.1/servers/7a48c163-1acb-4ff4-8f2e-b6b529707da4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:49:12.250246 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-4cd68450-64bb-4027-a384-19aed05bddfb tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:12.250734 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-4cd68450-64bb-4027-a384-19aed05bddfb tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:12.256796 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4cd68450-64bb-4027-a384-19aed05bddfb tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:12.257431 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4cd68450-64bb-4027-a384-19aed05bddfb tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:12.257930 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4cd68450-64bb-4027-a384-19aed05bddfb tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:12.258699 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4cd68450-64bb-4027-a384-19aed05bddfb tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:12.259152 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4cd68450-64bb-4027-a384-19aed05bddfb tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:12.259819 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-4cd68450-64bb-4027-a384-19aed05bddfb tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:12.273889 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.wsgi [None req-4cd68450-64bb-4027-a384-19aed05bddfb tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] HTTP exception thrown: Instance 1c74fb45-ef8a-4a88-8126-21c8266fddb2 could not be found. Oct 19 00:49:12.275450 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-4cd68450-64bb-4027-a384-19aed05bddfb tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Request method failure captured: Oct 19 00:49:12.275450 dv-cinder-master-3-smb devstack@n-api.service[125532]: request: DELETE /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 HTTP/1.1 Oct 19 00:49:12.275450 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept: application/json Oct 19 00:49:12.275450 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept-Encoding: identity Oct 19 00:49:12.275450 dv-cinder-master-3-smb devstack@n-api.service[125532]: Connection: close Oct 19 00:49:12.275450 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Length: 0 Oct 19 00:49:12.275450 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Type: application/json Oct 19 00:49:12.275450 dv-cinder-master-3-smb devstack@n-api.service[125532]: Host: 10.222.0.33 Oct 19 00:49:12.275450 dv-cinder-master-3-smb devstack@n-api.service[125532]: Openstack-System-Scope: None Oct 19 00:49:12.275450 dv-cinder-master-3-smb devstack@n-api.service[125532]: User-Agent: python-urllib3/1.26.12 Oct 19 00:49:12.275450 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Auth-Token: gAAAAABjT0dURaQ0HkRLJEsGfzC_hRt4QN5ysEIaY_BdQncL37G8-e-M3ZjfrgebU4tcOIRdKUHJ-8z0aMZ640IHN49nGivJqqNyX0ZANulCJEroSNvpy7R_0fS2-vNh5ZgaMp1tnHwZD8YVTbC5bIUu683iJQuGIijDZuo9O89CoiTmfOhMdZY Oct 19 00:49:12.275450 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Id: None Oct 19 00:49:12.275450 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Name: None Oct 19 00:49:12.275450 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Identity-Status: Confirmed Oct 19 00:49:12.275450 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Is-Admin-Project: True Oct 19 00:49:12.275450 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 00:49:12.275450 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Id: default Oct 19 00:49:12.275450 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Name: Default Oct 19 00:49:12.275450 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Id: 5e171056a4354ca695c18f115bfb750f Oct 19 00:49:12.275450 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-150806215 Oct 19 00:49:12.275450 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Role: member,reader Oct 19 00:49:12.275450 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Roles: member,reader Oct 19 00:49:12.277962 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5e171056a4354ca695c18f115bfb750f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5e171056a4354ca695c18f115bfb750f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5e171056a4354ca695c18f115bfb750f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5e171056a4354ca695c18f115bfb750f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:49:12.277962 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant: tempest-AttachVolumeShelveTestJSON-150806215 Oct 19 00:49:12.277962 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Id: 5e171056a4354ca695c18f115bfb750f Oct 19 00:49:12.277962 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-150806215 Oct 19 00:49:12.277962 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User: tempest-AttachVolumeShelveTestJSON-150806215-project Oct 19 00:49:12.277962 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Id: default Oct 19 00:49:12.277962 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Name: Default Oct 19 00:49:12.277962 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Id: 59bad833caf84817b8553d699b2fa04f Oct 19 00:49:12.277962 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Name: tempest-AttachVolumeShelveTestJSON-150806215-project Oct 19 00:49:12.277962 dv-cinder-master-3-smb devstack@n-api.service[125532]: method: > Oct 19 00:49:12.277962 dv-cinder-master-3-smb devstack@n-api.service[125532]: exception: Instance 1c74fb45-ef8a-4a88-8126-21c8266fddb2 could not be found. Oct 19 00:49:12.277962 dv-cinder-master-3-smb devstack@n-api.service[125532]: action_args: {'id': '1c74fb45-ef8a-4a88-8126-21c8266fddb2'} Oct 19 00:49:12.278882 dv-cinder-master-3-smb devstack@n-api.service[125532]: {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:49:12.278882 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:12.278882 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:49:12.278882 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:49:12.278882 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:49:12.278882 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:49:12.278882 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:49:12.278882 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:49:12.278882 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:49:12.278882 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:49:12.278882 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c74fb45-ef8a-4a88-8126-21c8266fddb2 could not be found. Oct 19 00:49:12.278882 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:49:12.278882 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:49:12.278882 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:49:12.278882 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:12.278882 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:49:12.278882 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:49:12.278882 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:49:12.278882 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:49:12.278882 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:49:12.280419 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:49:12.280419 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 00:49:12.280419 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 00:49:12.280419 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 00:49:12.280419 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 00:49:12.280419 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:49:12.280419 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:49:12.280419 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:49:12.280419 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:49:12.280419 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c74fb45-ef8a-4a88-8126-21c8266fddb2 could not be found. Oct 19 00:49:12.280419 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:49:12.280419 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:49:12.280419 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:49:12.280419 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:12.280419 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:49:12.280419 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:49:12.280419 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:49:12.280419 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:49:12.280419 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c74fb45-ef8a-4a88-8126-21c8266fddb2 could not be found. Oct 19 00:49:12.280419 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:49:12.282037 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-4cd68450-64bb-4027-a384-19aed05bddfb tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Returning 404 to user: Instance 1c74fb45-ef8a-4a88-8126-21c8266fddb2 could not be found. {{(pid=125532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:49:12.282037 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-4cd68450-64bb-4027-a384-19aed05bddfb tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 404 len: 111 microversion: 2.20 time: 0.031881 Oct 19 00:49:12.282037 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 535/1053] 10.222.0.33 () {60 vars in 1280 bytes} [Wed Oct 19 00:49:12 2022] DELETE /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:49:12.286091 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-09aade9a-dc6f-4fa3-907a-53e65d7e6801 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:12.286712 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-09aade9a-dc6f-4fa3-907a-53e65d7e6801 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] [instance: 1c74fb45-ef8a-4a88-8126-21c8266fddb2] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:12.294410 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-09aade9a-dc6f-4fa3-907a-53e65d7e6801 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:12.295128 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-09aade9a-dc6f-4fa3-907a-53e65d7e6801 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:12.295591 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-09aade9a-dc6f-4fa3-907a-53e65d7e6801 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:12.296720 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-09aade9a-dc6f-4fa3-907a-53e65d7e6801 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:12.297264 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-09aade9a-dc6f-4fa3-907a-53e65d7e6801 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:12.297689 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-09aade9a-dc6f-4fa3-907a-53e65d7e6801 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:12.312455 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.wsgi [None req-09aade9a-dc6f-4fa3-907a-53e65d7e6801 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] HTTP exception thrown: Instance 1c74fb45-ef8a-4a88-8126-21c8266fddb2 could not be found. Oct 19 00:49:12.314027 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-09aade9a-dc6f-4fa3-907a-53e65d7e6801 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Request method failure captured: Oct 19 00:49:12.314027 dv-cinder-master-3-smb devstack@n-api.service[125531]: request: GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 HTTP/1.1 Oct 19 00:49:12.314027 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept: application/json Oct 19 00:49:12.314027 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept-Encoding: identity Oct 19 00:49:12.314027 dv-cinder-master-3-smb devstack@n-api.service[125531]: Connection: close Oct 19 00:49:12.314027 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Length: 0 Oct 19 00:49:12.314027 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Type: application/json Oct 19 00:49:12.314027 dv-cinder-master-3-smb devstack@n-api.service[125531]: Host: 10.222.0.33 Oct 19 00:49:12.314027 dv-cinder-master-3-smb devstack@n-api.service[125531]: Openstack-System-Scope: None Oct 19 00:49:12.314027 dv-cinder-master-3-smb devstack@n-api.service[125531]: User-Agent: python-urllib3/1.26.12 Oct 19 00:49:12.314027 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Auth-Token: gAAAAABjT0dURaQ0HkRLJEsGfzC_hRt4QN5ysEIaY_BdQncL37G8-e-M3ZjfrgebU4tcOIRdKUHJ-8z0aMZ640IHN49nGivJqqNyX0ZANulCJEroSNvpy7R_0fS2-vNh5ZgaMp1tnHwZD8YVTbC5bIUu683iJQuGIijDZuo9O89CoiTmfOhMdZY Oct 19 00:49:12.314027 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Id: None Oct 19 00:49:12.314027 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Name: None Oct 19 00:49:12.314027 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Identity-Status: Confirmed Oct 19 00:49:12.314027 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Is-Admin-Project: True Oct 19 00:49:12.314027 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 00:49:12.314027 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Id: default Oct 19 00:49:12.314027 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Name: Default Oct 19 00:49:12.314027 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Id: 5e171056a4354ca695c18f115bfb750f Oct 19 00:49:12.314027 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-150806215 Oct 19 00:49:12.314027 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Role: member,reader Oct 19 00:49:12.314027 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Roles: member,reader Oct 19 00:49:12.315523 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5e171056a4354ca695c18f115bfb750f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5e171056a4354ca695c18f115bfb750f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5e171056a4354ca695c18f115bfb750f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5e171056a4354ca695c18f115bfb750f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:49:12.315523 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant: tempest-AttachVolumeShelveTestJSON-150806215 Oct 19 00:49:12.315523 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Id: 5e171056a4354ca695c18f115bfb750f Oct 19 00:49:12.315523 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-150806215 Oct 19 00:49:12.315523 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User: tempest-AttachVolumeShelveTestJSON-150806215-project Oct 19 00:49:12.315523 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Id: default Oct 19 00:49:12.315523 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Name: Default Oct 19 00:49:12.315523 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Id: 59bad833caf84817b8553d699b2fa04f Oct 19 00:49:12.315523 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Name: tempest-AttachVolumeShelveTestJSON-150806215-project Oct 19 00:49:12.315523 dv-cinder-master-3-smb devstack@n-api.service[125531]: method: > Oct 19 00:49:12.315523 dv-cinder-master-3-smb devstack@n-api.service[125531]: exception: Instance 1c74fb45-ef8a-4a88-8126-21c8266fddb2 could not be found. Oct 19 00:49:12.315523 dv-cinder-master-3-smb devstack@n-api.service[125531]: action_args: {'id': '1c74fb45-ef8a-4a88-8126-21c8266fddb2'} Oct 19 00:49:12.316414 dv-cinder-master-3-smb devstack@n-api.service[125531]: {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:49:12.316414 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:12.316414 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:49:12.316414 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:49:12.316414 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:49:12.316414 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:49:12.316414 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:49:12.316414 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:49:12.316414 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:49:12.316414 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:49:12.316414 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c74fb45-ef8a-4a88-8126-21c8266fddb2 could not be found. Oct 19 00:49:12.316414 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:49:12.316414 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:49:12.316414 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:49:12.316414 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:12.316414 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:49:12.316414 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:49:12.316414 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:49:12.316414 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:49:12.316414 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:49:12.317697 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:49:12.317697 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:49:12.317697 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:49:12.317697 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:49:12.317697 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:49:12.317697 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:49:12.317697 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:49:12.317697 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c74fb45-ef8a-4a88-8126-21c8266fddb2 could not be found. Oct 19 00:49:12.317697 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:49:12.317697 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:49:12.317697 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:49:12.317697 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:12.317697 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:49:12.317697 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:49:12.317697 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:49:12.317697 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:49:12.317697 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c74fb45-ef8a-4a88-8126-21c8266fddb2 could not be found. Oct 19 00:49:12.317697 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:49:12.319126 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-09aade9a-dc6f-4fa3-907a-53e65d7e6801 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] Returning 404 to user: Instance 1c74fb45-ef8a-4a88-8126-21c8266fddb2 could not be found. {{(pid=125531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:49:12.319126 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-09aade9a-dc6f-4fa3-907a-53e65d7e6801 tempest-AttachVolumeShelveTestJSON-150806215 tempest-AttachVolumeShelveTestJSON-150806215-project] 10.222.0.33 "GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2" status: 404 len: 111 microversion: 2.20 time: 0.033561 Oct 19 00:49:12.319126 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 519/1054] 10.222.0.33 () {60 vars in 1277 bytes} [Wed Oct 19 00:49:12 2022] GET /compute/v2.1/servers/1c74fb45-ef8a-4a88-8126-21c8266fddb2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:49:17.121765 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-8d226584-ab49-4eff-a1c2-c0bbe28e3f4e tempest-VolumesGetTestJSON-170340528 tempest-VolumesGetTestJSON-170340528-project] Action: 'create', calling method: .version_select at 0x7f81f12195e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1389678796", "metadata": {"Type": "work"}}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:17.452404 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-8d226584-ab49-4eff-a1c2-c0bbe28e3f4e tempest-VolumesGetTestJSON-170340528 tempest-VolumesGetTestJSON-170340528-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.462501 Oct 19 00:49:17.453477 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 536/1055] 10.222.0.33 () {60 vars in 1156 bytes} [Wed Oct 19 00:49:16 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 465 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 19 00:49:17.466954 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-ff986800-9ac6-4dbb-bd85-8dbfc7e843ee tempest-VolumesGetTestJSON-170340528 tempest-VolumesGetTestJSON-170340528-project] Calling method '.version_select at 0x7f81f0ffcf70>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:17.539696 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-ff986800-9ac6-4dbb-bd85-8dbfc7e843ee tempest-VolumesGetTestJSON-170340528 tempest-VolumesGetTestJSON-170340528-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/3596be63-a670-4009-b3d7-3a7fa86b83a8" status: 200 len: 353 microversion: 2.1 time: 0.076641 Oct 19 00:49:17.540507 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 520/1056] 10.222.0.33 () {58 vars in 1245 bytes} [Wed Oct 19 00:49:17 2022] GET /compute/v2.1/os-volumes/3596be63-a670-4009-b3d7-3a7fa86b83a8 => generated 353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:18.555219 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-2ac2b2b4-c032-403f-9f49-5bed14b7f25a tempest-VolumesGetTestJSON-170340528 tempest-VolumesGetTestJSON-170340528-project] Calling method '.version_select at 0x7f81f10405e0>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:18.604736 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-2ac2b2b4-c032-403f-9f49-5bed14b7f25a tempest-VolumesGetTestJSON-170340528 tempest-VolumesGetTestJSON-170340528-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/3596be63-a670-4009-b3d7-3a7fa86b83a8" status: 200 len: 354 microversion: 2.1 time: 0.053346 Oct 19 00:49:18.608064 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 537/1057] 10.222.0.33 () {58 vars in 1245 bytes} [Wed Oct 19 00:49:18 2022] GET /compute/v2.1/os-volumes/3596be63-a670-4009-b3d7-3a7fa86b83a8 => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:18.621094 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-f031f3a9-3d48-4b1a-9c3e-fb211f2860f1 tempest-VolumesGetTestJSON-170340528 tempest-VolumesGetTestJSON-170340528-project] Calling method '.version_select at 0x7f81f1140ee0>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:18.676272 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-f031f3a9-3d48-4b1a-9c3e-fb211f2860f1 tempest-VolumesGetTestJSON-170340528 tempest-VolumesGetTestJSON-170340528-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/3596be63-a670-4009-b3d7-3a7fa86b83a8" status: 200 len: 354 microversion: 2.1 time: 0.060807 Oct 19 00:49:18.676836 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 521/1058] 10.222.0.33 () {58 vars in 1245 bytes} [Wed Oct 19 00:49:18 2022] GET /compute/v2.1/os-volumes/3596be63-a670-4009-b3d7-3a7fa86b83a8 => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:18.695353 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-f43b49e6-180d-46c1-a8cf-c73895a521b4 tempest-VolumesGetTestJSON-170340528 tempest-VolumesGetTestJSON-170340528-project] Calling method '.version_select at 0x7f81f0fb5430>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:18.764220 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-f43b49e6-180d-46c1-a8cf-c73895a521b4 tempest-VolumesGetTestJSON-170340528 tempest-VolumesGetTestJSON-170340528-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/3596be63-a670-4009-b3d7-3a7fa86b83a8" status: 202 len: 0 microversion: 2.1 time: 0.072744 Oct 19 00:49:18.764788 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 538/1059] 10.222.0.33 () {58 vars in 1248 bytes} [Wed Oct 19 00:49:18 2022] DELETE /compute/v2.1/os-volumes/3596be63-a670-4009-b3d7-3a7fa86b83a8 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:49:18.773706 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-83ce2121-d45c-4acb-af5b-710f621c12c3 tempest-VolumesGetTestJSON-170340528 tempest-VolumesGetTestJSON-170340528-project] Calling method '.version_select at 0x7f81f1140a60>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:18.822767 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-83ce2121-d45c-4acb-af5b-710f621c12c3 tempest-VolumesGetTestJSON-170340528 tempest-VolumesGetTestJSON-170340528-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/3596be63-a670-4009-b3d7-3a7fa86b83a8" status: 200 len: 353 microversion: 2.1 time: 0.053220 Oct 19 00:49:18.823505 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 522/1060] 10.222.0.33 () {58 vars in 1245 bytes} [Wed Oct 19 00:49:18 2022] GET /compute/v2.1/os-volumes/3596be63-a670-4009-b3d7-3a7fa86b83a8 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:19.838888 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-a08e8e3c-958f-448a-9655-121e5fb7fd46 tempest-VolumesGetTestJSON-170340528 tempest-VolumesGetTestJSON-170340528-project] Calling method '.version_select at 0x7f81f102c280>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:19.867919 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.wsgi [None req-a08e8e3c-958f-448a-9655-121e5fb7fd46 tempest-VolumesGetTestJSON-170340528 tempest-VolumesGetTestJSON-170340528-project] HTTP exception thrown: Volume 3596be63-a670-4009-b3d7-3a7fa86b83a8 could not be found. Oct 19 00:49:19.869953 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-a08e8e3c-958f-448a-9655-121e5fb7fd46 tempest-VolumesGetTestJSON-170340528 tempest-VolumesGetTestJSON-170340528-project] Request method failure captured: Oct 19 00:49:19.869953 dv-cinder-master-3-smb devstack@n-api.service[125532]: request: GET /compute/v2.1/os-volumes/3596be63-a670-4009-b3d7-3a7fa86b83a8 HTTP/1.1 Oct 19 00:49:19.869953 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept: application/json Oct 19 00:49:19.869953 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept-Encoding: identity Oct 19 00:49:19.869953 dv-cinder-master-3-smb devstack@n-api.service[125532]: Connection: close Oct 19 00:49:19.869953 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Length: 0 Oct 19 00:49:19.869953 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Type: application/json Oct 19 00:49:19.869953 dv-cinder-master-3-smb devstack@n-api.service[125532]: Host: 10.222.0.33 Oct 19 00:49:19.869953 dv-cinder-master-3-smb devstack@n-api.service[125532]: Openstack-System-Scope: None Oct 19 00:49:19.869953 dv-cinder-master-3-smb devstack@n-api.service[125532]: User-Agent: python-urllib3/1.26.12 Oct 19 00:49:19.869953 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Auth-Token: gAAAAABjT0mM5P2LQCsxdoedlF7pHjgcb2PTTuJEOStylp3rLUi8wyjIch-7ZeCuKqTR4r8xVrut00E9tN7ptKLKztW8QbLKlB1nawXIT44WSNqZuTMoe3r_Vg_SpQT7M9v-4sIUeNfFc_FmKEdso8tCxhizoRJ1QtuLRfiJhEoWdU1xPzRpG8U Oct 19 00:49:19.869953 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Id: None Oct 19 00:49:19.869953 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Name: None Oct 19 00:49:19.869953 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Identity-Status: Confirmed Oct 19 00:49:19.869953 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Is-Admin-Project: True Oct 19 00:49:19.869953 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Id: default Oct 19 00:49:19.869953 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Name: Default Oct 19 00:49:19.869953 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Id: a58e669febcd49499c300594920ba37a Oct 19 00:49:19.869953 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Name: tempest-VolumesGetTestJSON-170340528 Oct 19 00:49:19.869953 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Role: member,reader Oct 19 00:49:19.869953 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Roles: member,reader Oct 19 00:49:19.871843 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a58e669febcd49499c300594920ba37a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58e669febcd49499c300594920ba37a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a58e669febcd49499c300594920ba37a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a58e669febcd49499c300594920ba37a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:49:19.871843 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant: tempest-VolumesGetTestJSON-170340528 Oct 19 00:49:19.871843 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Id: a58e669febcd49499c300594920ba37a Oct 19 00:49:19.871843 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Name: tempest-VolumesGetTestJSON-170340528 Oct 19 00:49:19.871843 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User: tempest-VolumesGetTestJSON-170340528-project Oct 19 00:49:19.871843 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Id: default Oct 19 00:49:19.871843 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Name: Default Oct 19 00:49:19.871843 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Id: 20fb9b534a4e4961855b826edbcf7e82 Oct 19 00:49:19.871843 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Name: tempest-VolumesGetTestJSON-170340528-project Oct 19 00:49:19.871843 dv-cinder-master-3-smb devstack@n-api.service[125532]: method: Oct 19 00:49:19.871843 dv-cinder-master-3-smb devstack@n-api.service[125532]: exception: Volume 3596be63-a670-4009-b3d7-3a7fa86b83a8 could not be found. Oct 19 00:49:19.871843 dv-cinder-master-3-smb devstack@n-api.service[125532]: action_args: {'id': '3596be63-a670-4009-b3d7-3a7fa86b83a8'} Oct 19 00:49:19.871843 dv-cinder-master-3-smb devstack@n-api.service[125532]: {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:49:19.873020 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:19.873020 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 00:49:19.873020 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 00:49:19.873020 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 00:49:19.873020 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 00:49:19.873020 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 00:49:19.873020 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 00:49:19.873020 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 00:49:19.873020 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 00:49:19.873020 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 00:49:19.873020 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 00:49:19.873020 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 00:49:19.873020 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 00:49:19.873020 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 00:49:19.873020 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 00:49:19.873020 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3596be63-a670-4009-b3d7-3a7fa86b83a8 could not be found. (HTTP 404) (Request-ID: req-1a9131bb-7da1-42d9-940f-bc08a5a5a17a) Oct 19 00:49:19.873020 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:49:19.873020 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:49:19.873020 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:49:19.874457 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:19.874457 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 19 00:49:19.874457 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 19 00:49:19.874457 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 00:49:19.874457 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 00:49:19.874457 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 00:49:19.874457 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 00:49:19.874457 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 00:49:19.874457 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 00:49:19.874457 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 00:49:19.874457 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 00:49:19.874457 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 00:49:19.874457 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 00:49:19.874457 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 00:49:19.874457 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 00:49:19.874457 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 00:49:19.874457 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 00:49:19.874457 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 00:49:19.874457 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 00:49:19.876228 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 00:49:19.876228 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 00:49:19.876228 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 00:49:19.876228 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 00:49:19.876228 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3596be63-a670-4009-b3d7-3a7fa86b83a8 could not be found. Oct 19 00:49:19.876228 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:49:19.876228 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:49:19.876228 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:49:19.876228 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:19.876228 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:49:19.876228 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:49:19.876228 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:49:19.876228 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:49:19.876228 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:49:19.876228 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:49:19.876228 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:49:19.876228 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:49:19.876228 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 19 00:49:19.876228 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:49:19.877667 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3596be63-a670-4009-b3d7-3a7fa86b83a8 could not be found. Oct 19 00:49:19.877667 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:49:19.877667 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:49:19.877667 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:49:19.877667 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:19.877667 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:49:19.877667 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:49:19.877667 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:49:19.877667 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:49:19.877667 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3596be63-a670-4009-b3d7-3a7fa86b83a8 could not be found. Oct 19 00:49:19.877667 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:49:19.877667 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-a08e8e3c-958f-448a-9655-121e5fb7fd46 tempest-VolumesGetTestJSON-170340528 tempest-VolumesGetTestJSON-170340528-project] Returning 404 to user: Volume 3596be63-a670-4009-b3d7-3a7fa86b83a8 could not be found. {{(pid=125532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:49:19.877667 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-a08e8e3c-958f-448a-9655-121e5fb7fd46 tempest-VolumesGetTestJSON-170340528 tempest-VolumesGetTestJSON-170340528-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/3596be63-a670-4009-b3d7-3a7fa86b83a8" status: 404 len: 109 microversion: 2.1 time: 0.037646 Oct 19 00:49:19.877667 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 539/1061] 10.222.0.33 () {58 vars in 1245 bytes} [Wed Oct 19 00:49:19 2022] GET /compute/v2.1/os-volumes/3596be63-a670-4009-b3d7-3a7fa86b83a8 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:49:50.779641 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:50.780458 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:50.784540 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-15b9a487-7232-40cf-a774-50d5200ed981 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-733675915", "imageRef": "d1f4abc9-3bb9-4343-9a05-53d758070c9d", "flavorRef": "452", "networks": [{"uuid": "0baa9232-7535-4ed0-a347-bc9be599623b"}]}} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:50.994982 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.network.neutron [None req-15b9a487-7232-40cf-a774-50d5200ed981 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] validate_networks() for [('0baa9232-7535-4ed0-a347-bc9be599623b', None, None, None, None, None)] {{(pid=125531) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:49:51.353711 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-15b9a487-7232-40cf-a774-50d5200ed981 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Flavor limits 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:49:51.354724 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-15b9a487-7232-40cf-a774-50d5200ed981 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Image limits 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:49:51.355228 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-15b9a487-7232-40cf-a774-50d5200ed981 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Flavor pref 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:49:51.355633 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-15b9a487-7232-40cf-a774-50d5200ed981 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Image pref 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:49:51.356203 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-15b9a487-7232-40cf-a774-50d5200ed981 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:49:51.365033 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-15b9a487-7232-40cf-a774-50d5200ed981 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:51.365502 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-15b9a487-7232-40cf-a774-50d5200ed981 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:51.366069 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-15b9a487-7232-40cf-a774-50d5200ed981 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:51.367097 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-15b9a487-7232-40cf-a774-50d5200ed981 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:51.367666 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-15b9a487-7232-40cf-a774-50d5200ed981 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:51.368386 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-15b9a487-7232-40cf-a774-50d5200ed981 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:51.387366 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.quota [None req-15b9a487-7232-40cf-a774-50d5200ed981 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Getting quotas for project bfcdd7dffd25494f88a8ae0976f0fd60. Resources: {'instances', 'cores', 'ram'} {{(pid=125531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:49:51.391255 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.quota [None req-15b9a487-7232-40cf-a774-50d5200ed981 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Getting quotas for user be7e343af85d4874bbdd86208c3cbe31 and project bfcdd7dffd25494f88a8ae0976f0fd60. Resources: {'instances', 'cores', 'ram'} {{(pid=125531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:49:51.402544 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-15b9a487-7232-40cf-a774-50d5200ed981 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Going to run 1 instances... {{(pid=125531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:49:51.404977 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-15b9a487-7232-40cf-a774-50d5200ed981 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] [instance: e92baa3a-c7e0-459b-8a32-363e74510cb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1f4abc9-3bb9-4343-9a05-53d758070c9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:49:51.452759 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-15b9a487-7232-40cf-a774-50d5200ed981 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.674353 Oct 19 00:49:51.453459 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 523/1062] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Oct 19 00:49:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:49:51.463836 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:51.464702 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell1:SELECT=9 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:51.470864 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-ba70083d-1828-4f17-bbac-471020889453 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:51.471996 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-ba70083d-1828-4f17-bbac-471020889453 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] [instance: e92baa3a-c7e0-459b-8a32-363e74510cb0] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:51.588736 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-ba70083d-1828-4f17-bbac-471020889453 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e343af85d4874bbdd86208c3cbe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcdd7dffd25494f88a8ae0976f0fd60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:51.596147 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-ba70083d-1828-4f17-bbac-471020889453 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] 10.222.0.33 "GET /compute/v2.1/servers/e92baa3a-c7e0-459b-8a32-363e74510cb0" status: 200 len: 1213 microversion: 2.1 time: 0.135051 Oct 19 00:49:51.596702 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 540/1063] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:51 2022] GET /compute/v2.1/servers/e92baa3a-c7e0-459b-8a32-363e74510cb0 => generated 1213 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:52.620971 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-35e20de0-89ed-4361-936f-6fcd7edbfbd9 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:52.622999 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-35e20de0-89ed-4361-936f-6fcd7edbfbd9 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] [instance: e92baa3a-c7e0-459b-8a32-363e74510cb0] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:52.629242 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-35e20de0-89ed-4361-936f-6fcd7edbfbd9 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:52.629932 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-35e20de0-89ed-4361-936f-6fcd7edbfbd9 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:52.630365 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-35e20de0-89ed-4361-936f-6fcd7edbfbd9 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:52.631220 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-35e20de0-89ed-4361-936f-6fcd7edbfbd9 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:52.631818 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-35e20de0-89ed-4361-936f-6fcd7edbfbd9 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:52.632431 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-35e20de0-89ed-4361-936f-6fcd7edbfbd9 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:52.699108 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-35e20de0-89ed-4361-936f-6fcd7edbfbd9 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e343af85d4874bbdd86208c3cbe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcdd7dffd25494f88a8ae0976f0fd60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:52.708700 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-35e20de0-89ed-4361-936f-6fcd7edbfbd9 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] 10.222.0.33 "GET /compute/v2.1/servers/e92baa3a-c7e0-459b-8a32-363e74510cb0" status: 200 len: 1283 microversion: 2.1 time: 0.092259 Oct 19 00:49:52.709203 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 524/1064] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:52 2022] GET /compute/v2.1/servers/e92baa3a-c7e0-459b-8a32-363e74510cb0 => generated 1283 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:53.732834 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-18dd751c-d098-4029-b9aa-c00717462ff8 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:53.733447 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-18dd751c-d098-4029-b9aa-c00717462ff8 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] [instance: e92baa3a-c7e0-459b-8a32-363e74510cb0] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:53.739928 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-18dd751c-d098-4029-b9aa-c00717462ff8 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:53.740419 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-18dd751c-d098-4029-b9aa-c00717462ff8 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:53.740854 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-18dd751c-d098-4029-b9aa-c00717462ff8 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:53.741630 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-18dd751c-d098-4029-b9aa-c00717462ff8 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:53.742091 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-18dd751c-d098-4029-b9aa-c00717462ff8 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:53.742519 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-18dd751c-d098-4029-b9aa-c00717462ff8 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:53.933726 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-18dd751c-d098-4029-b9aa-c00717462ff8 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e343af85d4874bbdd86208c3cbe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcdd7dffd25494f88a8ae0976f0fd60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:53.941381 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-18dd751c-d098-4029-b9aa-c00717462ff8 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] 10.222.0.33 "GET /compute/v2.1/servers/e92baa3a-c7e0-459b-8a32-363e74510cb0" status: 200 len: 1313 microversion: 2.1 time: 0.212976 Oct 19 00:49:53.941964 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 541/1065] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:53 2022] GET /compute/v2.1/servers/e92baa3a-c7e0-459b-8a32-363e74510cb0 => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:53.984954 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-21e9c695-3275-4884-acd4-cf06e0148ec9 req-6d48169d-4723-475c-9448-53b684909174 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e92baa3a-c7e0-459b-8a32-363e74510cb0", "tag": "2dd1b2b2-4bc6-451e-b9e0-3a6d26c2acd3"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:53.997738 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-21e9c695-3275-4884-acd4-cf06e0148ec9 req-6d48169d-4723-475c-9448-53b684909174 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:53.998636 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-21e9c695-3275-4884-acd4-cf06e0148ec9 req-6d48169d-4723-475c-9448-53b684909174 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:53.999073 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-21e9c695-3275-4884-acd4-cf06e0148ec9 req-6d48169d-4723-475c-9448-53b684909174 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:54.010555 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-21e9c695-3275-4884-acd4-cf06e0148ec9 req-6d48169d-4723-475c-9448-53b684909174 service nova] Creating event network-changed:2dd1b2b2-4bc6-451e-b9e0-3a6d26c2acd3 for instance e92baa3a-c7e0-459b-8a32-363e74510cb0 on hv-cinder-maste Oct 19 00:49:54.015322 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-21e9c695-3275-4884-acd4-cf06e0148ec9 req-6d48169d-4723-475c-9448-53b684909174 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034128 Oct 19 00:49:54.015935 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 525/1066] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:54.965795 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-07ddf02a-5d12-4c46-bcc0-e09e116ea32c tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:54.966409 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-07ddf02a-5d12-4c46-bcc0-e09e116ea32c tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] [instance: e92baa3a-c7e0-459b-8a32-363e74510cb0] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:54.972801 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-07ddf02a-5d12-4c46-bcc0-e09e116ea32c tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:54.973288 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-07ddf02a-5d12-4c46-bcc0-e09e116ea32c tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:54.973718 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-07ddf02a-5d12-4c46-bcc0-e09e116ea32c tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:54.974410 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-07ddf02a-5d12-4c46-bcc0-e09e116ea32c tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:54.974863 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-07ddf02a-5d12-4c46-bcc0-e09e116ea32c tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:54.975285 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-07ddf02a-5d12-4c46-bcc0-e09e116ea32c tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:55.106566 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-07ddf02a-5d12-4c46-bcc0-e09e116ea32c tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e343af85d4874bbdd86208c3cbe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcdd7dffd25494f88a8ae0976f0fd60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:55.114125 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-07ddf02a-5d12-4c46-bcc0-e09e116ea32c tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] 10.222.0.33 "GET /compute/v2.1/servers/e92baa3a-c7e0-459b-8a32-363e74510cb0" status: 200 len: 1313 microversion: 2.1 time: 0.152359 Oct 19 00:49:55.114691 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 542/1067] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:54 2022] GET /compute/v2.1/servers/e92baa3a-c7e0-459b-8a32-363e74510cb0 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:56.139709 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-d664d8fe-9bfd-4e83-83a4-02d462eac677 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:56.140442 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-d664d8fe-9bfd-4e83-83a4-02d462eac677 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] [instance: e92baa3a-c7e0-459b-8a32-363e74510cb0] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:56.146606 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d664d8fe-9bfd-4e83-83a4-02d462eac677 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:56.147087 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d664d8fe-9bfd-4e83-83a4-02d462eac677 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:56.147524 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d664d8fe-9bfd-4e83-83a4-02d462eac677 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:56.148249 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d664d8fe-9bfd-4e83-83a4-02d462eac677 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:56.148701 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d664d8fe-9bfd-4e83-83a4-02d462eac677 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:56.149124 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-d664d8fe-9bfd-4e83-83a4-02d462eac677 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:56.280748 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-d664d8fe-9bfd-4e83-83a4-02d462eac677 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e343af85d4874bbdd86208c3cbe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcdd7dffd25494f88a8ae0976f0fd60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:56.288343 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-d664d8fe-9bfd-4e83-83a4-02d462eac677 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] 10.222.0.33 "GET /compute/v2.1/servers/e92baa3a-c7e0-459b-8a32-363e74510cb0" status: 200 len: 1313 microversion: 2.1 time: 0.153882 Oct 19 00:49:56.288906 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 526/1068] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:56 2022] GET /compute/v2.1/servers/e92baa3a-c7e0-459b-8a32-363e74510cb0 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:57.312120 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-70f1b342-4dff-4258-bf16-1a702634f75d tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:57.312728 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-70f1b342-4dff-4258-bf16-1a702634f75d tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] [instance: e92baa3a-c7e0-459b-8a32-363e74510cb0] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:57.319404 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-70f1b342-4dff-4258-bf16-1a702634f75d tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:57.319895 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-70f1b342-4dff-4258-bf16-1a702634f75d tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:57.320330 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-70f1b342-4dff-4258-bf16-1a702634f75d tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:57.321010 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-70f1b342-4dff-4258-bf16-1a702634f75d tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:57.321461 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-70f1b342-4dff-4258-bf16-1a702634f75d tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:57.321877 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-70f1b342-4dff-4258-bf16-1a702634f75d tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:57.453546 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-70f1b342-4dff-4258-bf16-1a702634f75d tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e343af85d4874bbdd86208c3cbe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcdd7dffd25494f88a8ae0976f0fd60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:57.461137 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-70f1b342-4dff-4258-bf16-1a702634f75d tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] 10.222.0.33 "GET /compute/v2.1/servers/e92baa3a-c7e0-459b-8a32-363e74510cb0" status: 200 len: 1313 microversion: 2.1 time: 0.154103 Oct 19 00:49:57.461692 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 543/1069] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:57 2022] GET /compute/v2.1/servers/e92baa3a-c7e0-459b-8a32-363e74510cb0 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:58.485161 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-9b04bedc-8550-411f-9431-b0839fea5a62 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:58.485775 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-9b04bedc-8550-411f-9431-b0839fea5a62 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] [instance: e92baa3a-c7e0-459b-8a32-363e74510cb0] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:58.493000 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9b04bedc-8550-411f-9431-b0839fea5a62 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:58.493484 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9b04bedc-8550-411f-9431-b0839fea5a62 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:58.493920 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9b04bedc-8550-411f-9431-b0839fea5a62 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:58.495158 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9b04bedc-8550-411f-9431-b0839fea5a62 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:58.495611 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9b04bedc-8550-411f-9431-b0839fea5a62 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:58.496056 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-9b04bedc-8550-411f-9431-b0839fea5a62 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:58.625414 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-9b04bedc-8550-411f-9431-b0839fea5a62 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e343af85d4874bbdd86208c3cbe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcdd7dffd25494f88a8ae0976f0fd60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:58.633170 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-9b04bedc-8550-411f-9431-b0839fea5a62 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] 10.222.0.33 "GET /compute/v2.1/servers/e92baa3a-c7e0-459b-8a32-363e74510cb0" status: 200 len: 1313 microversion: 2.1 time: 0.151814 Oct 19 00:49:58.633709 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 527/1070] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:58 2022] GET /compute/v2.1/servers/e92baa3a-c7e0-459b-8a32-363e74510cb0 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:59.656528 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-c8c15732-8798-48d3-9745-50f160e50788 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:59.657188 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-c8c15732-8798-48d3-9745-50f160e50788 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] [instance: e92baa3a-c7e0-459b-8a32-363e74510cb0] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:59.664127 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c8c15732-8798-48d3-9745-50f160e50788 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:59.664605 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c8c15732-8798-48d3-9745-50f160e50788 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:59.665036 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c8c15732-8798-48d3-9745-50f160e50788 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:59.665761 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c8c15732-8798-48d3-9745-50f160e50788 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:59.666264 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c8c15732-8798-48d3-9745-50f160e50788 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:59.666819 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-c8c15732-8798-48d3-9745-50f160e50788 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:59.798712 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-c8c15732-8798-48d3-9745-50f160e50788 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e343af85d4874bbdd86208c3cbe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcdd7dffd25494f88a8ae0976f0fd60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:59.806573 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-c8c15732-8798-48d3-9745-50f160e50788 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] 10.222.0.33 "GET /compute/v2.1/servers/e92baa3a-c7e0-459b-8a32-363e74510cb0" status: 200 len: 1313 microversion: 2.1 time: 0.154573 Oct 19 00:49:59.807196 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 544/1071] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:59 2022] GET /compute/v2.1/servers/e92baa3a-c7e0-459b-8a32-363e74510cb0 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:00.415536 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-8b70afa2-4e2f-48a5-b464-ac9b2d8a2426 req-5d1eeb53-d322-4dc5-83a6-17349e28d255 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e92baa3a-c7e0-459b-8a32-363e74510cb0", "name": "network-vif-plugged", "status": "completed", "tag": "2dd1b2b2-4bc6-451e-b9e0-3a6d26c2acd3"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:00.427823 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-8b70afa2-4e2f-48a5-b464-ac9b2d8a2426 req-5d1eeb53-d322-4dc5-83a6-17349e28d255 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:00.428341 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-8b70afa2-4e2f-48a5-b464-ac9b2d8a2426 req-5d1eeb53-d322-4dc5-83a6-17349e28d255 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:00.428775 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-8b70afa2-4e2f-48a5-b464-ac9b2d8a2426 req-5d1eeb53-d322-4dc5-83a6-17349e28d255 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:00.440827 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-8b70afa2-4e2f-48a5-b464-ac9b2d8a2426 req-5d1eeb53-d322-4dc5-83a6-17349e28d255 service nova] Creating event network-vif-plugged:2dd1b2b2-4bc6-451e-b9e0-3a6d26c2acd3 for instance e92baa3a-c7e0-459b-8a32-363e74510cb0 on hv-cinder-maste Oct 19 00:50:00.445850 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-8b70afa2-4e2f-48a5-b464-ac9b2d8a2426 req-5d1eeb53-d322-4dc5-83a6-17349e28d255 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034027 Oct 19 00:50:00.446619 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 528/1072] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:00.830589 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-fa31182a-6a57-4b1f-957b-8fcf9bcdccbc tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:00.831204 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-fa31182a-6a57-4b1f-957b-8fcf9bcdccbc tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] [instance: e92baa3a-c7e0-459b-8a32-363e74510cb0] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:00.837604 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-fa31182a-6a57-4b1f-957b-8fcf9bcdccbc tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:00.838610 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-fa31182a-6a57-4b1f-957b-8fcf9bcdccbc tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:00.839166 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-fa31182a-6a57-4b1f-957b-8fcf9bcdccbc tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:00.839881 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-fa31182a-6a57-4b1f-957b-8fcf9bcdccbc tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:00.840338 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-fa31182a-6a57-4b1f-957b-8fcf9bcdccbc tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:00.840764 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-fa31182a-6a57-4b1f-957b-8fcf9bcdccbc tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:00.970172 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-fa31182a-6a57-4b1f-957b-8fcf9bcdccbc tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e343af85d4874bbdd86208c3cbe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcdd7dffd25494f88a8ae0976f0fd60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:00.977999 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-fa31182a-6a57-4b1f-957b-8fcf9bcdccbc tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] 10.222.0.33 "GET /compute/v2.1/servers/e92baa3a-c7e0-459b-8a32-363e74510cb0" status: 200 len: 1313 microversion: 2.1 time: 0.151311 Oct 19 00:50:00.978567 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 545/1073] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:00 2022] GET /compute/v2.1/servers/e92baa3a-c7e0-459b-8a32-363e74510cb0 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:02.002625 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-824eb02d-da6c-455d-927b-45ae073fa24a tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:02.003363 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-824eb02d-da6c-455d-927b-45ae073fa24a tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] [instance: e92baa3a-c7e0-459b-8a32-363e74510cb0] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:02.005377 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell0:SELECT=2 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:02.006034 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell0:SELECT=6 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:02.013342 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-824eb02d-da6c-455d-927b-45ae073fa24a tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:02.013822 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-824eb02d-da6c-455d-927b-45ae073fa24a tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:02.014261 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-824eb02d-da6c-455d-927b-45ae073fa24a tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:02.014980 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-824eb02d-da6c-455d-927b-45ae073fa24a tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:02.015438 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-824eb02d-da6c-455d-927b-45ae073fa24a tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:02.015870 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-824eb02d-da6c-455d-927b-45ae073fa24a tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:02.148246 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-824eb02d-da6c-455d-927b-45ae073fa24a tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e343af85d4874bbdd86208c3cbe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcdd7dffd25494f88a8ae0976f0fd60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:02.155829 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-824eb02d-da6c-455d-927b-45ae073fa24a tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] 10.222.0.33 "GET /compute/v2.1/servers/e92baa3a-c7e0-459b-8a32-363e74510cb0" status: 200 len: 1313 microversion: 2.1 time: 0.157489 Oct 19 00:50:02.156407 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 529/1074] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:01 2022] GET /compute/v2.1/servers/e92baa3a-c7e0-459b-8a32-363e74510cb0 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:03.179090 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-0a901e44-6815-4c00-8a9f-a7d600ef92ec tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:03.179698 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-0a901e44-6815-4c00-8a9f-a7d600ef92ec tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] [instance: e92baa3a-c7e0-459b-8a32-363e74510cb0] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:03.181649 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell0:SELECT=2 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:03.188448 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0a901e44-6815-4c00-8a9f-a7d600ef92ec tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:03.188926 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0a901e44-6815-4c00-8a9f-a7d600ef92ec tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:03.189355 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0a901e44-6815-4c00-8a9f-a7d600ef92ec tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:03.190040 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0a901e44-6815-4c00-8a9f-a7d600ef92ec tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:03.190487 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0a901e44-6815-4c00-8a9f-a7d600ef92ec tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:03.190906 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-0a901e44-6815-4c00-8a9f-a7d600ef92ec tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:03.321497 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-0a901e44-6815-4c00-8a9f-a7d600ef92ec tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e343af85d4874bbdd86208c3cbe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcdd7dffd25494f88a8ae0976f0fd60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:03.329738 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-0a901e44-6815-4c00-8a9f-a7d600ef92ec tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] 10.222.0.33 "GET /compute/v2.1/servers/e92baa3a-c7e0-459b-8a32-363e74510cb0" status: 200 len: 1497 microversion: 2.1 time: 0.154509 Oct 19 00:50:03.330308 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 546/1075] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:03 2022] GET /compute/v2.1/servers/e92baa3a-c7e0-459b-8a32-363e74510cb0 => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:03.750372 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-206c91b5-f439-4dd3-acad-4a1dac6001df tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:03.750938 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-206c91b5-f439-4dd3-acad-4a1dac6001df tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] [instance: e92baa3a-c7e0-459b-8a32-363e74510cb0] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:03.757462 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-206c91b5-f439-4dd3-acad-4a1dac6001df tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:03.757888 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-206c91b5-f439-4dd3-acad-4a1dac6001df tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:03.758324 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-206c91b5-f439-4dd3-acad-4a1dac6001df tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:03.759024 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-206c91b5-f439-4dd3-acad-4a1dac6001df tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:03.759482 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-206c91b5-f439-4dd3-acad-4a1dac6001df tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:03.759941 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-206c91b5-f439-4dd3-acad-4a1dac6001df tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:03.790523 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-206c91b5-f439-4dd3-acad-4a1dac6001df tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] [instance: e92baa3a-c7e0-459b-8a32-363e74510cb0] Going to try to terminate instance {{(pid=125531) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:50:03.869679 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-206c91b5-f439-4dd3-acad-4a1dac6001df tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e92baa3a-c7e0-459b-8a32-363e74510cb0" status: 204 len: 0 microversion: 2.1 time: 0.123046 Oct 19 00:50:03.870253 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 530/1076] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Oct 19 00:50:03 2022] DELETE /compute/v2.1/servers/e92baa3a-c7e0-459b-8a32-363e74510cb0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:50:03.879756 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-08ce4e0c-2f61-4287-a5b6-c1f14cce76c0 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:03.880564 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-08ce4e0c-2f61-4287-a5b6-c1f14cce76c0 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] [instance: e92baa3a-c7e0-459b-8a32-363e74510cb0] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:03.886625 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-08ce4e0c-2f61-4287-a5b6-c1f14cce76c0 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:03.887153 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-08ce4e0c-2f61-4287-a5b6-c1f14cce76c0 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:03.887593 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-08ce4e0c-2f61-4287-a5b6-c1f14cce76c0 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:03.888317 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-08ce4e0c-2f61-4287-a5b6-c1f14cce76c0 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:03.888776 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-08ce4e0c-2f61-4287-a5b6-c1f14cce76c0 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:03.889235 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-08ce4e0c-2f61-4287-a5b6-c1f14cce76c0 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:04.018379 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-08ce4e0c-2f61-4287-a5b6-c1f14cce76c0 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e343af85d4874bbdd86208c3cbe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcdd7dffd25494f88a8ae0976f0fd60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:04.026023 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-08ce4e0c-2f61-4287-a5b6-c1f14cce76c0 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] 10.222.0.33 "GET /compute/v2.1/servers/e92baa3a-c7e0-459b-8a32-363e74510cb0" status: 200 len: 1503 microversion: 2.1 time: 0.150470 Oct 19 00:50:04.026587 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 547/1077] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:03 2022] GET /compute/v2.1/servers/e92baa3a-c7e0-459b-8a32-363e74510cb0 => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:05.051871 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-c6a72ec6-f221-402a-a04a-2d4d500726fd tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:05.052606 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-c6a72ec6-f221-402a-a04a-2d4d500726fd tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] [instance: e92baa3a-c7e0-459b-8a32-363e74510cb0] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:05.059084 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c6a72ec6-f221-402a-a04a-2d4d500726fd tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:05.059600 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c6a72ec6-f221-402a-a04a-2d4d500726fd tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:05.061320 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c6a72ec6-f221-402a-a04a-2d4d500726fd tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:05.062013 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c6a72ec6-f221-402a-a04a-2d4d500726fd tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:05.062465 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c6a72ec6-f221-402a-a04a-2d4d500726fd tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:05.062899 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-c6a72ec6-f221-402a-a04a-2d4d500726fd tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:05.197628 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-c6a72ec6-f221-402a-a04a-2d4d500726fd tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e343af85d4874bbdd86208c3cbe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcdd7dffd25494f88a8ae0976f0fd60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:05.205847 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-c6a72ec6-f221-402a-a04a-2d4d500726fd tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] 10.222.0.33 "GET /compute/v2.1/servers/e92baa3a-c7e0-459b-8a32-363e74510cb0" status: 200 len: 1503 microversion: 2.1 time: 0.159669 Oct 19 00:50:05.206465 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 531/1078] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:05 2022] GET /compute/v2.1/servers/e92baa3a-c7e0-459b-8a32-363e74510cb0 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:06.174104 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-a38f368b-94fe-4865-9b10-b45e121c4668 req-1c2d08d6-a762-48e6-a7cc-8c31fa0d2092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e92baa3a-c7e0-459b-8a32-363e74510cb0", "name": "network-vif-deleted", "tag": "2dd1b2b2-4bc6-451e-b9e0-3a6d26c2acd3"}]} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:06.184499 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-a38f368b-94fe-4865-9b10-b45e121c4668 req-1c2d08d6-a762-48e6-a7cc-8c31fa0d2092 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:06.185643 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-a38f368b-94fe-4865-9b10-b45e121c4668 req-1c2d08d6-a762-48e6-a7cc-8c31fa0d2092 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:06.186085 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-a38f368b-94fe-4865-9b10-b45e121c4668 req-1c2d08d6-a762-48e6-a7cc-8c31fa0d2092 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:06.197702 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.compute.server_external_events [req-a38f368b-94fe-4865-9b10-b45e121c4668 req-1c2d08d6-a762-48e6-a7cc-8c31fa0d2092 service nova] Creating event network-vif-deleted:2dd1b2b2-4bc6-451e-b9e0-3a6d26c2acd3 for instance e92baa3a-c7e0-459b-8a32-363e74510cb0 on hv-cinder-maste Oct 19 00:50:06.203599 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-a38f368b-94fe-4865-9b10-b45e121c4668 req-1c2d08d6-a762-48e6-a7cc-8c31fa0d2092 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033160 Oct 19 00:50:06.204240 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 548/1079] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:06.229521 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-40712259-9dc3-463a-9ed7-3d136cdd2d16 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:06.230241 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-40712259-9dc3-463a-9ed7-3d136cdd2d16 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] [instance: e92baa3a-c7e0-459b-8a32-363e74510cb0] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:06.237108 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-40712259-9dc3-463a-9ed7-3d136cdd2d16 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:06.237593 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-40712259-9dc3-463a-9ed7-3d136cdd2d16 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:06.238042 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-40712259-9dc3-463a-9ed7-3d136cdd2d16 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:06.238720 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-40712259-9dc3-463a-9ed7-3d136cdd2d16 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:06.239175 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-40712259-9dc3-463a-9ed7-3d136cdd2d16 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:06.239597 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-40712259-9dc3-463a-9ed7-3d136cdd2d16 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:06.307404 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-40712259-9dc3-463a-9ed7-3d136cdd2d16 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e343af85d4874bbdd86208c3cbe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcdd7dffd25494f88a8ae0976f0fd60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:06.316161 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-40712259-9dc3-463a-9ed7-3d136cdd2d16 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] 10.222.0.33 "GET /compute/v2.1/servers/e92baa3a-c7e0-459b-8a32-363e74510cb0" status: 200 len: 1298 microversion: 2.1 time: 0.091240 Oct 19 00:50:06.316730 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 532/1080] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:06 2022] GET /compute/v2.1/servers/e92baa3a-c7e0-459b-8a32-363e74510cb0 => generated 1298 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:07.339655 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-eecbc919-fd59-453e-beb0-f9fb633121b3 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:07.340301 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-eecbc919-fd59-453e-beb0-f9fb633121b3 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] [instance: e92baa3a-c7e0-459b-8a32-363e74510cb0] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:07.346882 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-eecbc919-fd59-453e-beb0-f9fb633121b3 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:07.347362 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-eecbc919-fd59-453e-beb0-f9fb633121b3 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:07.347798 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-eecbc919-fd59-453e-beb0-f9fb633121b3 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:07.348519 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-eecbc919-fd59-453e-beb0-f9fb633121b3 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:07.348970 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-eecbc919-fd59-453e-beb0-f9fb633121b3 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:07.349390 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-eecbc919-fd59-453e-beb0-f9fb633121b3 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:07.362514 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.wsgi [None req-eecbc919-fd59-453e-beb0-f9fb633121b3 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] HTTP exception thrown: Instance e92baa3a-c7e0-459b-8a32-363e74510cb0 could not be found. Oct 19 00:50:07.364208 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-eecbc919-fd59-453e-beb0-f9fb633121b3 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Request method failure captured: Oct 19 00:50:07.364208 dv-cinder-master-3-smb devstack@n-api.service[125532]: request: GET /compute/v2.1/servers/e92baa3a-c7e0-459b-8a32-363e74510cb0 HTTP/1.1 Oct 19 00:50:07.364208 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept: application/json Oct 19 00:50:07.364208 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept-Encoding: identity Oct 19 00:50:07.364208 dv-cinder-master-3-smb devstack@n-api.service[125532]: Connection: close Oct 19 00:50:07.364208 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Length: 0 Oct 19 00:50:07.364208 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Type: application/json Oct 19 00:50:07.364208 dv-cinder-master-3-smb devstack@n-api.service[125532]: Host: 10.222.0.33 Oct 19 00:50:07.364208 dv-cinder-master-3-smb devstack@n-api.service[125532]: Openstack-System-Scope: None Oct 19 00:50:07.364208 dv-cinder-master-3-smb devstack@n-api.service[125532]: User-Agent: python-urllib3/1.26.12 Oct 19 00:50:07.364208 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Auth-Token: gAAAAABjT0mtr1BLHYWYrnNjwHMf86fbyA2X2vkcUdyxdqrQ-w4o-jjRZU_ZBUQ9obyDurykeLtGOVAZ06v0dy2jCIFxR3NJzZWTmt2wqdVP1OaWAZnulRQJ2YnhsCw9mfMRDVOPHUvHF2ElXUHfWbR7U4Z4fVqDY8z0kJWJGm82MTp1I4XbP6U Oct 19 00:50:07.364208 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Id: None Oct 19 00:50:07.364208 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Name: None Oct 19 00:50:07.364208 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Identity-Status: Confirmed Oct 19 00:50:07.364208 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Is-Admin-Project: True Oct 19 00:50:07.364208 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Id: default Oct 19 00:50:07.364208 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Name: Default Oct 19 00:50:07.364208 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Id: bfcdd7dffd25494f88a8ae0976f0fd60 Oct 19 00:50:07.364208 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Name: tempest-VolumesActionsTest-628319386 Oct 19 00:50:07.364208 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Role: member,reader Oct 19 00:50:07.364208 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Roles: member,reader Oct 19 00:50:07.365909 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bfcdd7dffd25494f88a8ae0976f0fd60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bfcdd7dffd25494f88a8ae0976f0fd60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bfcdd7dffd25494f88a8ae0976f0fd60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bfcdd7dffd25494f88a8ae0976f0fd60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:50:07.365909 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant: tempest-VolumesActionsTest-628319386 Oct 19 00:50:07.365909 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Id: bfcdd7dffd25494f88a8ae0976f0fd60 Oct 19 00:50:07.365909 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Name: tempest-VolumesActionsTest-628319386 Oct 19 00:50:07.365909 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User: tempest-VolumesActionsTest-628319386-project Oct 19 00:50:07.365909 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Id: default Oct 19 00:50:07.365909 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Name: Default Oct 19 00:50:07.365909 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Id: be7e343af85d4874bbdd86208c3cbe31 Oct 19 00:50:07.365909 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Name: tempest-VolumesActionsTest-628319386-project Oct 19 00:50:07.365909 dv-cinder-master-3-smb devstack@n-api.service[125532]: method: > Oct 19 00:50:07.365909 dv-cinder-master-3-smb devstack@n-api.service[125532]: exception: Instance e92baa3a-c7e0-459b-8a32-363e74510cb0 could not be found. Oct 19 00:50:07.365909 dv-cinder-master-3-smb devstack@n-api.service[125532]: action_args: {'id': 'e92baa3a-c7e0-459b-8a32-363e74510cb0'} Oct 19 00:50:07.367230 dv-cinder-master-3-smb devstack@n-api.service[125532]: {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:50:07.367230 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:07.367230 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:50:07.367230 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:50:07.367230 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:50:07.367230 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:50:07.367230 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:50:07.367230 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:50:07.367230 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:50:07.367230 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:50:07.367230 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e92baa3a-c7e0-459b-8a32-363e74510cb0 could not be found. Oct 19 00:50:07.367230 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:50:07.367230 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:07.367230 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:50:07.367230 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:07.367230 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:07.367230 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:07.367230 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:50:07.367230 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:50:07.367230 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:50:07.368832 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:50:07.368832 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:50:07.368832 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:50:07.368832 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:50:07.368832 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:50:07.368832 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:50:07.368832 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:50:07.368832 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e92baa3a-c7e0-459b-8a32-363e74510cb0 could not be found. Oct 19 00:50:07.368832 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:50:07.368832 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:07.368832 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:50:07.368832 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:07.368832 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:07.368832 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:07.368832 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:50:07.368832 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:50:07.368832 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e92baa3a-c7e0-459b-8a32-363e74510cb0 could not be found. Oct 19 00:50:07.368832 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:50:07.371007 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-eecbc919-fd59-453e-beb0-f9fb633121b3 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Returning 404 to user: Instance e92baa3a-c7e0-459b-8a32-363e74510cb0 could not be found. {{(pid=125532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:50:07.371007 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-eecbc919-fd59-453e-beb0-f9fb633121b3 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] 10.222.0.33 "GET /compute/v2.1/servers/e92baa3a-c7e0-459b-8a32-363e74510cb0" status: 404 len: 111 microversion: 2.1 time: 0.030684 Oct 19 00:50:07.371007 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 549/1081] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:07 2022] GET /compute/v2.1/servers/e92baa3a-c7e0-459b-8a32-363e74510cb0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:50:07.471783 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-b7505aca-6128-4c4e-abe2-49c11dcd747c tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1273254948", "imageRef": "d1f4abc9-3bb9-4343-9a05-53d758070c9d", "flavorRef": "452", "networks": [{"uuid": "0baa9232-7535-4ed0-a347-bc9be599623b"}]}} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:07.527995 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.network.neutron [None req-b7505aca-6128-4c4e-abe2-49c11dcd747c tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] validate_networks() for [('0baa9232-7535-4ed0-a347-bc9be599623b', None, None, None, None, None)] {{(pid=125531) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:50:07.910277 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-b7505aca-6128-4c4e-abe2-49c11dcd747c tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Flavor limits 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:50:07.910757 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-b7505aca-6128-4c4e-abe2-49c11dcd747c tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Image limits 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:50:07.911248 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-b7505aca-6128-4c4e-abe2-49c11dcd747c tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Flavor pref 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:50:07.911706 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-b7505aca-6128-4c4e-abe2-49c11dcd747c tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Image pref 0:0:0 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:50:07.912407 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.virt.hardware [None req-b7505aca-6128-4c4e-abe2-49c11dcd747c tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:50:07.921945 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b7505aca-6128-4c4e-abe2-49c11dcd747c tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:07.922533 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b7505aca-6128-4c4e-abe2-49c11dcd747c tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:07.922981 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b7505aca-6128-4c4e-abe2-49c11dcd747c tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:07.923716 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b7505aca-6128-4c4e-abe2-49c11dcd747c tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:07.924199 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b7505aca-6128-4c4e-abe2-49c11dcd747c tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:07.924625 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b7505aca-6128-4c4e-abe2-49c11dcd747c tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:07.942370 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.quota [None req-b7505aca-6128-4c4e-abe2-49c11dcd747c tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Getting quotas for project bfcdd7dffd25494f88a8ae0976f0fd60. Resources: {'instances', 'cores', 'ram'} {{(pid=125531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:50:07.946363 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.quota [None req-b7505aca-6128-4c4e-abe2-49c11dcd747c tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Getting quotas for user be7e343af85d4874bbdd86208c3cbe31 and project bfcdd7dffd25494f88a8ae0976f0fd60. Resources: {'instances', 'cores', 'ram'} {{(pid=125531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:50:07.957768 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-b7505aca-6128-4c4e-abe2-49c11dcd747c tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Going to run 1 instances... {{(pid=125531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:50:07.960326 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-b7505aca-6128-4c4e-abe2-49c11dcd747c tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] [instance: 99261375-5957-4ed8-b990-7c74ef5d7557] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1f4abc9-3bb9-4343-9a05-53d758070c9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:50:08.009731 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-b7505aca-6128-4c4e-abe2-49c11dcd747c tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.541812 Oct 19 00:50:08.010380 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 533/1082] 10.222.0.33 () {60 vars in 1147 bytes} [Wed Oct 19 00:50:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:50:08.022067 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-93313fd8-b167-46dc-91b1-f7ffb7ccdb24 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:08.022863 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-93313fd8-b167-46dc-91b1-f7ffb7ccdb24 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] [instance: 99261375-5957-4ed8-b990-7c74ef5d7557] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:08.082071 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-93313fd8-b167-46dc-91b1-f7ffb7ccdb24 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e343af85d4874bbdd86208c3cbe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcdd7dffd25494f88a8ae0976f0fd60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:08.091620 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-93313fd8-b167-46dc-91b1-f7ffb7ccdb24 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] 10.222.0.33 "GET /compute/v2.1/servers/99261375-5957-4ed8-b990-7c74ef5d7557" status: 200 len: 1214 microversion: 2.1 time: 0.073293 Oct 19 00:50:08.101223 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 550/1083] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:08 2022] GET /compute/v2.1/servers/99261375-5957-4ed8-b990-7c74ef5d7557 => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:09.114954 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-753fb201-a944-44ab-97dc-5a1c9c9e885d tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:09.115578 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-753fb201-a944-44ab-97dc-5a1c9c9e885d tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] [instance: 99261375-5957-4ed8-b990-7c74ef5d7557] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:09.123143 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-753fb201-a944-44ab-97dc-5a1c9c9e885d tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:09.123628 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-753fb201-a944-44ab-97dc-5a1c9c9e885d tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:09.124097 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-753fb201-a944-44ab-97dc-5a1c9c9e885d tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:09.124787 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-753fb201-a944-44ab-97dc-5a1c9c9e885d tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:09.125241 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-753fb201-a944-44ab-97dc-5a1c9c9e885d tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:09.125667 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-753fb201-a944-44ab-97dc-5a1c9c9e885d tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:09.191937 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-753fb201-a944-44ab-97dc-5a1c9c9e885d tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e343af85d4874bbdd86208c3cbe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcdd7dffd25494f88a8ae0976f0fd60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:09.199645 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-753fb201-a944-44ab-97dc-5a1c9c9e885d tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] 10.222.0.33 "GET /compute/v2.1/servers/99261375-5957-4ed8-b990-7c74ef5d7557" status: 200 len: 1266 microversion: 2.1 time: 0.089021 Oct 19 00:50:09.201084 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 534/1084] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:09 2022] GET /compute/v2.1/servers/99261375-5957-4ed8-b990-7c74ef5d7557 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:10.227571 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-7835f7a2-3dfc-43d1-8a06-6e72486bf6dd tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:10.228446 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-7835f7a2-3dfc-43d1-8a06-6e72486bf6dd tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] [instance: 99261375-5957-4ed8-b990-7c74ef5d7557] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:10.236841 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7835f7a2-3dfc-43d1-8a06-6e72486bf6dd tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:10.237439 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7835f7a2-3dfc-43d1-8a06-6e72486bf6dd tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:10.238003 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7835f7a2-3dfc-43d1-8a06-6e72486bf6dd tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:10.238770 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7835f7a2-3dfc-43d1-8a06-6e72486bf6dd tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:10.239292 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7835f7a2-3dfc-43d1-8a06-6e72486bf6dd tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:10.239806 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-7835f7a2-3dfc-43d1-8a06-6e72486bf6dd tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:10.479783 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-7835f7a2-3dfc-43d1-8a06-6e72486bf6dd tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e343af85d4874bbdd86208c3cbe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcdd7dffd25494f88a8ae0976f0fd60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:10.488374 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-7835f7a2-3dfc-43d1-8a06-6e72486bf6dd tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] 10.222.0.33 "GET /compute/v2.1/servers/99261375-5957-4ed8-b990-7c74ef5d7557" status: 200 len: 1314 microversion: 2.1 time: 0.267866 Oct 19 00:50:10.489015 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 551/1085] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:10 2022] GET /compute/v2.1/servers/99261375-5957-4ed8-b990-7c74ef5d7557 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:11.036126 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-e64a07e9-2079-49e1-8c01-f28c2d5d00b2 req-72796a27-c8bf-437a-92ad-64e335e0650e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99261375-5957-4ed8-b990-7c74ef5d7557", "tag": "72a30b02-1135-45cd-884b-95f7f3c42d85"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:11.049133 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-e64a07e9-2079-49e1-8c01-f28c2d5d00b2 req-72796a27-c8bf-437a-92ad-64e335e0650e service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:11.049701 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-e64a07e9-2079-49e1-8c01-f28c2d5d00b2 req-72796a27-c8bf-437a-92ad-64e335e0650e service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:11.050206 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-e64a07e9-2079-49e1-8c01-f28c2d5d00b2 req-72796a27-c8bf-437a-92ad-64e335e0650e service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:11.062749 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-e64a07e9-2079-49e1-8c01-f28c2d5d00b2 req-72796a27-c8bf-437a-92ad-64e335e0650e service nova] Creating event network-changed:72a30b02-1135-45cd-884b-95f7f3c42d85 for instance 99261375-5957-4ed8-b990-7c74ef5d7557 on hv-cinder-maste Oct 19 00:50:11.068708 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-e64a07e9-2079-49e1-8c01-f28c2d5d00b2 req-72796a27-c8bf-437a-92ad-64e335e0650e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037070 Oct 19 00:50:11.069554 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 535/1086] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:50:11.512395 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-9de7fa44-bc24-4dc7-98f7-020e49131584 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:11.513285 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-9de7fa44-bc24-4dc7-98f7-020e49131584 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] [instance: 99261375-5957-4ed8-b990-7c74ef5d7557] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:11.526691 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9de7fa44-bc24-4dc7-98f7-020e49131584 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:11.526691 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9de7fa44-bc24-4dc7-98f7-020e49131584 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:11.526691 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9de7fa44-bc24-4dc7-98f7-020e49131584 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:11.526691 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9de7fa44-bc24-4dc7-98f7-020e49131584 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:11.527314 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9de7fa44-bc24-4dc7-98f7-020e49131584 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:11.527314 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-9de7fa44-bc24-4dc7-98f7-020e49131584 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:11.666081 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-9de7fa44-bc24-4dc7-98f7-020e49131584 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e343af85d4874bbdd86208c3cbe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcdd7dffd25494f88a8ae0976f0fd60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:11.673977 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-9de7fa44-bc24-4dc7-98f7-020e49131584 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] 10.222.0.33 "GET /compute/v2.1/servers/99261375-5957-4ed8-b990-7c74ef5d7557" status: 200 len: 1314 microversion: 2.1 time: 0.165921 Oct 19 00:50:11.674539 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 552/1087] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:11 2022] GET /compute/v2.1/servers/99261375-5957-4ed8-b990-7c74ef5d7557 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:12.697381 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-e9c1416a-94b7-4367-8615-2eb2a911542d tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:12.698112 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-e9c1416a-94b7-4367-8615-2eb2a911542d tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] [instance: 99261375-5957-4ed8-b990-7c74ef5d7557] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:12.706460 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e9c1416a-94b7-4367-8615-2eb2a911542d tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:12.707270 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e9c1416a-94b7-4367-8615-2eb2a911542d tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:12.708043 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e9c1416a-94b7-4367-8615-2eb2a911542d tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:12.709190 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e9c1416a-94b7-4367-8615-2eb2a911542d tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:12.709960 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e9c1416a-94b7-4367-8615-2eb2a911542d tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:12.710665 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-e9c1416a-94b7-4367-8615-2eb2a911542d tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:12.851881 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-e9c1416a-94b7-4367-8615-2eb2a911542d tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e343af85d4874bbdd86208c3cbe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcdd7dffd25494f88a8ae0976f0fd60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:12.859511 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-e9c1416a-94b7-4367-8615-2eb2a911542d tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] 10.222.0.33 "GET /compute/v2.1/servers/99261375-5957-4ed8-b990-7c74ef5d7557" status: 200 len: 1314 microversion: 2.1 time: 0.166400 Oct 19 00:50:12.860118 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 536/1088] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:12 2022] GET /compute/v2.1/servers/99261375-5957-4ed8-b990-7c74ef5d7557 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:13.882793 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-d5efce28-e9c2-463c-a84b-8d639acb175a tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:13.883737 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-d5efce28-e9c2-463c-a84b-8d639acb175a tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] [instance: 99261375-5957-4ed8-b990-7c74ef5d7557] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:13.891039 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d5efce28-e9c2-463c-a84b-8d639acb175a tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:13.891532 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d5efce28-e9c2-463c-a84b-8d639acb175a tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:13.891992 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d5efce28-e9c2-463c-a84b-8d639acb175a tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:13.892696 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d5efce28-e9c2-463c-a84b-8d639acb175a tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:13.893153 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d5efce28-e9c2-463c-a84b-8d639acb175a tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:13.893930 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-d5efce28-e9c2-463c-a84b-8d639acb175a tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:14.117757 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-d5efce28-e9c2-463c-a84b-8d639acb175a tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e343af85d4874bbdd86208c3cbe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcdd7dffd25494f88a8ae0976f0fd60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:14.132793 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-d5efce28-e9c2-463c-a84b-8d639acb175a tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] 10.222.0.33 "GET /compute/v2.1/servers/99261375-5957-4ed8-b990-7c74ef5d7557" status: 200 len: 1314 microversion: 2.1 time: 0.253722 Oct 19 00:50:14.134448 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 553/1089] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:13 2022] GET /compute/v2.1/servers/99261375-5957-4ed8-b990-7c74ef5d7557 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:15.158582 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-4951f391-5997-4d13-b773-e3018fef4602 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:15.159199 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-4951f391-5997-4d13-b773-e3018fef4602 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] [instance: 99261375-5957-4ed8-b990-7c74ef5d7557] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:15.165609 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4951f391-5997-4d13-b773-e3018fef4602 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:15.166092 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4951f391-5997-4d13-b773-e3018fef4602 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:15.166525 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4951f391-5997-4d13-b773-e3018fef4602 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:15.167220 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4951f391-5997-4d13-b773-e3018fef4602 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:15.167669 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4951f391-5997-4d13-b773-e3018fef4602 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:15.168125 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-4951f391-5997-4d13-b773-e3018fef4602 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:15.303696 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-4951f391-5997-4d13-b773-e3018fef4602 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e343af85d4874bbdd86208c3cbe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcdd7dffd25494f88a8ae0976f0fd60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:15.312054 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-4951f391-5997-4d13-b773-e3018fef4602 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] 10.222.0.33 "GET /compute/v2.1/servers/99261375-5957-4ed8-b990-7c74ef5d7557" status: 200 len: 1314 microversion: 2.1 time: 0.157891 Oct 19 00:50:15.312647 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 537/1090] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:15 2022] GET /compute/v2.1/servers/99261375-5957-4ed8-b990-7c74ef5d7557 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:16.336368 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-58dfe525-c2fc-4f2c-bf02-73969dfbee0a tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:16.336978 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-58dfe525-c2fc-4f2c-bf02-73969dfbee0a tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] [instance: 99261375-5957-4ed8-b990-7c74ef5d7557] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:16.343424 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-58dfe525-c2fc-4f2c-bf02-73969dfbee0a tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:16.343928 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-58dfe525-c2fc-4f2c-bf02-73969dfbee0a tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:16.344364 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-58dfe525-c2fc-4f2c-bf02-73969dfbee0a tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:16.345056 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-58dfe525-c2fc-4f2c-bf02-73969dfbee0a tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:16.345504 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-58dfe525-c2fc-4f2c-bf02-73969dfbee0a tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:16.345949 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-58dfe525-c2fc-4f2c-bf02-73969dfbee0a tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:16.485576 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-58dfe525-c2fc-4f2c-bf02-73969dfbee0a tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e343af85d4874bbdd86208c3cbe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcdd7dffd25494f88a8ae0976f0fd60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:16.494428 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-58dfe525-c2fc-4f2c-bf02-73969dfbee0a tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] 10.222.0.33 "GET /compute/v2.1/servers/99261375-5957-4ed8-b990-7c74ef5d7557" status: 200 len: 1314 microversion: 2.1 time: 0.161818 Oct 19 00:50:16.495105 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 554/1091] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:16 2022] GET /compute/v2.1/servers/99261375-5957-4ed8-b990-7c74ef5d7557 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:17.518220 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-7118d927-99dc-4a75-9008-df03c48423cc tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:17.518769 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-7118d927-99dc-4a75-9008-df03c48423cc tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] [instance: 99261375-5957-4ed8-b990-7c74ef5d7557] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:17.525170 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7118d927-99dc-4a75-9008-df03c48423cc tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:17.525645 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7118d927-99dc-4a75-9008-df03c48423cc tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:17.526084 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7118d927-99dc-4a75-9008-df03c48423cc tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:17.526775 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7118d927-99dc-4a75-9008-df03c48423cc tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:17.527224 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7118d927-99dc-4a75-9008-df03c48423cc tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:17.527646 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-7118d927-99dc-4a75-9008-df03c48423cc tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:17.665456 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-7118d927-99dc-4a75-9008-df03c48423cc tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e343af85d4874bbdd86208c3cbe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcdd7dffd25494f88a8ae0976f0fd60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:17.673714 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-7118d927-99dc-4a75-9008-df03c48423cc tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] 10.222.0.33 "GET /compute/v2.1/servers/99261375-5957-4ed8-b990-7c74ef5d7557" status: 200 len: 1314 microversion: 2.1 time: 0.160228 Oct 19 00:50:17.674271 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 538/1092] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:17 2022] GET /compute/v2.1/servers/99261375-5957-4ed8-b990-7c74ef5d7557 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:18.462911 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-d4c2eacc-4406-4cb5-8913-ecfc9d2a8dce req-322fa3ba-f82e-4e8c-9e6d-66054b56c0c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99261375-5957-4ed8-b990-7c74ef5d7557", "name": "network-vif-plugged", "status": "completed", "tag": "72a30b02-1135-45cd-884b-95f7f3c42d85"}]} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:18.470574 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell0:SELECT=2 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:18.477626 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-d4c2eacc-4406-4cb5-8913-ecfc9d2a8dce req-322fa3ba-f82e-4e8c-9e6d-66054b56c0c5 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:18.478104 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-d4c2eacc-4406-4cb5-8913-ecfc9d2a8dce req-322fa3ba-f82e-4e8c-9e6d-66054b56c0c5 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:18.478529 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-d4c2eacc-4406-4cb5-8913-ecfc9d2a8dce req-322fa3ba-f82e-4e8c-9e6d-66054b56c0c5 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:18.490290 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.compute.server_external_events [req-d4c2eacc-4406-4cb5-8913-ecfc9d2a8dce req-322fa3ba-f82e-4e8c-9e6d-66054b56c0c5 service nova] Creating event network-vif-plugged:72a30b02-1135-45cd-884b-95f7f3c42d85 for instance 99261375-5957-4ed8-b990-7c74ef5d7557 on hv-cinder-maste Oct 19 00:50:18.495304 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-d4c2eacc-4406-4cb5-8913-ecfc9d2a8dce req-322fa3ba-f82e-4e8c-9e6d-66054b56c0c5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036294 Oct 19 00:50:18.496697 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 555/1093] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:50:18.696867 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-6a148af3-a685-4630-bd7b-48bf4c0530ea tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:18.697537 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-6a148af3-a685-4630-bd7b-48bf4c0530ea tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] [instance: 99261375-5957-4ed8-b990-7c74ef5d7557] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:18.699577 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell0:SELECT=2 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:18.700348 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell0:SELECT=6 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:18.707266 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6a148af3-a685-4630-bd7b-48bf4c0530ea tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:18.707745 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6a148af3-a685-4630-bd7b-48bf4c0530ea tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:18.708199 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6a148af3-a685-4630-bd7b-48bf4c0530ea tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:18.708914 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6a148af3-a685-4630-bd7b-48bf4c0530ea tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:18.709337 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6a148af3-a685-4630-bd7b-48bf4c0530ea tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:18.709754 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-6a148af3-a685-4630-bd7b-48bf4c0530ea tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:18.839725 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-6a148af3-a685-4630-bd7b-48bf4c0530ea tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e343af85d4874bbdd86208c3cbe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcdd7dffd25494f88a8ae0976f0fd60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:18.848203 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-6a148af3-a685-4630-bd7b-48bf4c0530ea tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] 10.222.0.33 "GET /compute/v2.1/servers/99261375-5957-4ed8-b990-7c74ef5d7557" status: 200 len: 1314 microversion: 2.1 time: 0.155318 Oct 19 00:50:18.848768 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 539/1094] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:18 2022] GET /compute/v2.1/servers/99261375-5957-4ed8-b990-7c74ef5d7557 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:19.872582 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-09bf48cf-9aea-480a-bcc8-dedabd04ac42 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:19.873897 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-09bf48cf-9aea-480a-bcc8-dedabd04ac42 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] [instance: 99261375-5957-4ed8-b990-7c74ef5d7557] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:19.880666 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-09bf48cf-9aea-480a-bcc8-dedabd04ac42 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:19.881150 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-09bf48cf-9aea-480a-bcc8-dedabd04ac42 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:19.881586 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-09bf48cf-9aea-480a-bcc8-dedabd04ac42 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:19.882284 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-09bf48cf-9aea-480a-bcc8-dedabd04ac42 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:19.882743 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-09bf48cf-9aea-480a-bcc8-dedabd04ac42 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:19.883172 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-09bf48cf-9aea-480a-bcc8-dedabd04ac42 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:20.018135 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-09bf48cf-9aea-480a-bcc8-dedabd04ac42 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e343af85d4874bbdd86208c3cbe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcdd7dffd25494f88a8ae0976f0fd60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:20.027370 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-09bf48cf-9aea-480a-bcc8-dedabd04ac42 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] 10.222.0.33 "GET /compute/v2.1/servers/99261375-5957-4ed8-b990-7c74ef5d7557" status: 200 len: 1314 microversion: 2.1 time: 0.159265 Oct 19 00:50:20.028155 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 556/1095] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:19 2022] GET /compute/v2.1/servers/99261375-5957-4ed8-b990-7c74ef5d7557 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:21.051827 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-0d273f4b-b136-4765-acf4-13d0f13e8eed tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:21.052460 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-0d273f4b-b136-4765-acf4-13d0f13e8eed tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] [instance: 99261375-5957-4ed8-b990-7c74ef5d7557] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:21.055137 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:21.060384 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0d273f4b-b136-4765-acf4-13d0f13e8eed tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:21.061578 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0d273f4b-b136-4765-acf4-13d0f13e8eed tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:21.062458 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0d273f4b-b136-4765-acf4-13d0f13e8eed tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:21.063153 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0d273f4b-b136-4765-acf4-13d0f13e8eed tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:21.063610 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0d273f4b-b136-4765-acf4-13d0f13e8eed tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:21.064064 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-0d273f4b-b136-4765-acf4-13d0f13e8eed tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:21.067427 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:21.205939 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-0d273f4b-b136-4765-acf4-13d0f13e8eed tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e343af85d4874bbdd86208c3cbe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcdd7dffd25494f88a8ae0976f0fd60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:21.214796 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-0d273f4b-b136-4765-acf4-13d0f13e8eed tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] 10.222.0.33 "GET /compute/v2.1/servers/99261375-5957-4ed8-b990-7c74ef5d7557" status: 200 len: 1497 microversion: 2.1 time: 0.166558 Oct 19 00:50:21.215491 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 540/1096] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:21 2022] GET /compute/v2.1/servers/99261375-5957-4ed8-b990-7c74ef5d7557 => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:21.728173 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-14fb403e-cb1d-4e47-9b5e-5bc5e43d38aa tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:21.728722 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-14fb403e-cb1d-4e47-9b5e-5bc5e43d38aa tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] [instance: 99261375-5957-4ed8-b990-7c74ef5d7557] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:21.731119 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_api:SELECT=39 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:21.737297 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-14fb403e-cb1d-4e47-9b5e-5bc5e43d38aa tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:21.737595 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-14fb403e-cb1d-4e47-9b5e-5bc5e43d38aa tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:21.738032 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-14fb403e-cb1d-4e47-9b5e-5bc5e43d38aa tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:21.738734 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-14fb403e-cb1d-4e47-9b5e-5bc5e43d38aa tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:21.739187 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-14fb403e-cb1d-4e47-9b5e-5bc5e43d38aa tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:21.739613 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-14fb403e-cb1d-4e47-9b5e-5bc5e43d38aa tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:21.742539 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell1:SELECT=79 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:21.766010 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-14fb403e-cb1d-4e47-9b5e-5bc5e43d38aa tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] [instance: 99261375-5957-4ed8-b990-7c74ef5d7557] Going to try to terminate instance {{(pid=125532) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:50:21.843801 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-14fb403e-cb1d-4e47-9b5e-5bc5e43d38aa tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] 10.222.0.33 "DELETE /compute/v2.1/servers/99261375-5957-4ed8-b990-7c74ef5d7557" status: 204 len: 0 microversion: 2.1 time: 0.118804 Oct 19 00:50:21.847557 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 557/1097] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Oct 19 00:50:21 2022] DELETE /compute/v2.1/servers/99261375-5957-4ed8-b990-7c74ef5d7557 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:50:21.853174 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-b950fe56-3957-414e-a2aa-2b1102814381 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:21.853792 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-b950fe56-3957-414e-a2aa-2b1102814381 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] [instance: 99261375-5957-4ed8-b990-7c74ef5d7557] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:21.860978 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b950fe56-3957-414e-a2aa-2b1102814381 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:21.861559 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b950fe56-3957-414e-a2aa-2b1102814381 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:21.862065 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b950fe56-3957-414e-a2aa-2b1102814381 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:21.862965 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b950fe56-3957-414e-a2aa-2b1102814381 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:21.863492 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b950fe56-3957-414e-a2aa-2b1102814381 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:21.864051 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-b950fe56-3957-414e-a2aa-2b1102814381 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:21.995731 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-b950fe56-3957-414e-a2aa-2b1102814381 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e343af85d4874bbdd86208c3cbe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcdd7dffd25494f88a8ae0976f0fd60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:22.004906 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-b950fe56-3957-414e-a2aa-2b1102814381 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] 10.222.0.33 "GET /compute/v2.1/servers/99261375-5957-4ed8-b990-7c74ef5d7557" status: 200 len: 1503 microversion: 2.1 time: 0.155533 Oct 19 00:50:22.005487 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 541/1098] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:21 2022] GET /compute/v2.1/servers/99261375-5957-4ed8-b990-7c74ef5d7557 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:50:23.028535 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-64d02cb4-112f-4ce3-8e96-1c3d0d277234 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:23.029239 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-64d02cb4-112f-4ce3-8e96-1c3d0d277234 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] [instance: 99261375-5957-4ed8-b990-7c74ef5d7557] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:23.036207 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-64d02cb4-112f-4ce3-8e96-1c3d0d277234 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:23.036815 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-64d02cb4-112f-4ce3-8e96-1c3d0d277234 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:23.037282 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-64d02cb4-112f-4ce3-8e96-1c3d0d277234 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:23.038010 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-64d02cb4-112f-4ce3-8e96-1c3d0d277234 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:23.038474 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-64d02cb4-112f-4ce3-8e96-1c3d0d277234 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:23.038998 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-64d02cb4-112f-4ce3-8e96-1c3d0d277234 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:23.171333 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-64d02cb4-112f-4ce3-8e96-1c3d0d277234 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e343af85d4874bbdd86208c3cbe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcdd7dffd25494f88a8ae0976f0fd60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:23.179162 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-64d02cb4-112f-4ce3-8e96-1c3d0d277234 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] 10.222.0.33 "GET /compute/v2.1/servers/99261375-5957-4ed8-b990-7c74ef5d7557" status: 200 len: 1503 microversion: 2.1 time: 0.155156 Oct 19 00:50:23.179800 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 558/1099] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:23 2022] GET /compute/v2.1/servers/99261375-5957-4ed8-b990-7c74ef5d7557 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:24.059630 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-7e07d3d3-7af3-4dfb-9cb5-f935f889c3e0 req-dda442e3-55c1-405e-9b08-143e8d7e6a0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99261375-5957-4ed8-b990-7c74ef5d7557", "name": "network-vif-deleted", "tag": "72a30b02-1135-45cd-884b-95f7f3c42d85"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:24.069567 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-7e07d3d3-7af3-4dfb-9cb5-f935f889c3e0 req-dda442e3-55c1-405e-9b08-143e8d7e6a0e service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:24.070041 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-7e07d3d3-7af3-4dfb-9cb5-f935f889c3e0 req-dda442e3-55c1-405e-9b08-143e8d7e6a0e service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:24.070467 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-7e07d3d3-7af3-4dfb-9cb5-f935f889c3e0 req-dda442e3-55c1-405e-9b08-143e8d7e6a0e service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:24.081941 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-7e07d3d3-7af3-4dfb-9cb5-f935f889c3e0 req-dda442e3-55c1-405e-9b08-143e8d7e6a0e service nova] Creating event network-vif-deleted:72a30b02-1135-45cd-884b-95f7f3c42d85 for instance 99261375-5957-4ed8-b990-7c74ef5d7557 on hv-cinder-maste Oct 19 00:50:24.086958 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-7e07d3d3-7af3-4dfb-9cb5-f935f889c3e0 req-dda442e3-55c1-405e-9b08-143e8d7e6a0e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165775 Oct 19 00:50:24.087909 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 542/1100] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:24.203585 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-91f21b5d-575c-4571-b616-164986f32d2b tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:24.204256 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-91f21b5d-575c-4571-b616-164986f32d2b tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] [instance: 99261375-5957-4ed8-b990-7c74ef5d7557] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:24.210353 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-91f21b5d-575c-4571-b616-164986f32d2b tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:24.210802 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-91f21b5d-575c-4571-b616-164986f32d2b tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:24.211263 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-91f21b5d-575c-4571-b616-164986f32d2b tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:24.212009 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-91f21b5d-575c-4571-b616-164986f32d2b tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:24.212483 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-91f21b5d-575c-4571-b616-164986f32d2b tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:24.212920 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-91f21b5d-575c-4571-b616-164986f32d2b tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:24.244387 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-91f21b5d-575c-4571-b616-164986f32d2b tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:24.244865 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-91f21b5d-575c-4571-b616-164986f32d2b tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:24.245301 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-91f21b5d-575c-4571-b616-164986f32d2b tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:24.245748 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.objects.instance [None req-91f21b5d-575c-4571-b616-164986f32d2b tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lazy-loading 'fault' on Instance uuid 99261375-5957-4ed8-b990-7c74ef5d7557 {{(pid=125532) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:50:24.288041 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-91f21b5d-575c-4571-b616-164986f32d2b tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e343af85d4874bbdd86208c3cbe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcdd7dffd25494f88a8ae0976f0fd60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:24.295790 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-91f21b5d-575c-4571-b616-164986f32d2b tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] 10.222.0.33 "GET /compute/v2.1/servers/99261375-5957-4ed8-b990-7c74ef5d7557" status: 200 len: 1304 microversion: 2.1 time: 0.097061 Oct 19 00:50:24.296946 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 559/1101] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:24 2022] GET /compute/v2.1/servers/99261375-5957-4ed8-b990-7c74ef5d7557 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:25.320814 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-dcccb599-c049-4327-b93e-b72d713e7236 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:25.321512 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-dcccb599-c049-4327-b93e-b72d713e7236 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] [instance: 99261375-5957-4ed8-b990-7c74ef5d7557] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:25.328711 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dcccb599-c049-4327-b93e-b72d713e7236 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:25.328867 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dcccb599-c049-4327-b93e-b72d713e7236 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:25.329276 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dcccb599-c049-4327-b93e-b72d713e7236 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:25.329964 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dcccb599-c049-4327-b93e-b72d713e7236 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:25.330413 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dcccb599-c049-4327-b93e-b72d713e7236 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:25.330833 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-dcccb599-c049-4327-b93e-b72d713e7236 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:25.344565 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.wsgi [None req-dcccb599-c049-4327-b93e-b72d713e7236 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] HTTP exception thrown: Instance 99261375-5957-4ed8-b990-7c74ef5d7557 could not be found. Oct 19 00:50:25.346197 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-dcccb599-c049-4327-b93e-b72d713e7236 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Request method failure captured: Oct 19 00:50:25.346197 dv-cinder-master-3-smb devstack@n-api.service[125531]: request: GET /compute/v2.1/servers/99261375-5957-4ed8-b990-7c74ef5d7557 HTTP/1.1 Oct 19 00:50:25.346197 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept: application/json Oct 19 00:50:25.346197 dv-cinder-master-3-smb devstack@n-api.service[125531]: Accept-Encoding: identity Oct 19 00:50:25.346197 dv-cinder-master-3-smb devstack@n-api.service[125531]: Connection: close Oct 19 00:50:25.346197 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Length: 0 Oct 19 00:50:25.346197 dv-cinder-master-3-smb devstack@n-api.service[125531]: Content-Type: application/json Oct 19 00:50:25.346197 dv-cinder-master-3-smb devstack@n-api.service[125531]: Host: 10.222.0.33 Oct 19 00:50:25.346197 dv-cinder-master-3-smb devstack@n-api.service[125531]: Openstack-System-Scope: None Oct 19 00:50:25.346197 dv-cinder-master-3-smb devstack@n-api.service[125531]: User-Agent: python-urllib3/1.26.12 Oct 19 00:50:25.346197 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Auth-Token: gAAAAABjT0mtr1BLHYWYrnNjwHMf86fbyA2X2vkcUdyxdqrQ-w4o-jjRZU_ZBUQ9obyDurykeLtGOVAZ06v0dy2jCIFxR3NJzZWTmt2wqdVP1OaWAZnulRQJ2YnhsCw9mfMRDVOPHUvHF2ElXUHfWbR7U4Z4fVqDY8z0kJWJGm82MTp1I4XbP6U Oct 19 00:50:25.346197 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Id: None Oct 19 00:50:25.346197 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Domain-Name: None Oct 19 00:50:25.346197 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Identity-Status: Confirmed Oct 19 00:50:25.346197 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Is-Admin-Project: True Oct 19 00:50:25.346197 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Id: default Oct 19 00:50:25.346197 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Domain-Name: Default Oct 19 00:50:25.346197 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Id: bfcdd7dffd25494f88a8ae0976f0fd60 Oct 19 00:50:25.346197 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Project-Name: tempest-VolumesActionsTest-628319386 Oct 19 00:50:25.346197 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Role: member,reader Oct 19 00:50:25.346197 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Roles: member,reader Oct 19 00:50:25.347900 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bfcdd7dffd25494f88a8ae0976f0fd60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bfcdd7dffd25494f88a8ae0976f0fd60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bfcdd7dffd25494f88a8ae0976f0fd60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bfcdd7dffd25494f88a8ae0976f0fd60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:50:25.347900 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant: tempest-VolumesActionsTest-628319386 Oct 19 00:50:25.347900 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Id: bfcdd7dffd25494f88a8ae0976f0fd60 Oct 19 00:50:25.347900 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-Tenant-Name: tempest-VolumesActionsTest-628319386 Oct 19 00:50:25.347900 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User: tempest-VolumesActionsTest-628319386-project Oct 19 00:50:25.347900 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Id: default Oct 19 00:50:25.347900 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Domain-Name: Default Oct 19 00:50:25.347900 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Id: be7e343af85d4874bbdd86208c3cbe31 Oct 19 00:50:25.347900 dv-cinder-master-3-smb devstack@n-api.service[125531]: X-User-Name: tempest-VolumesActionsTest-628319386-project Oct 19 00:50:25.347900 dv-cinder-master-3-smb devstack@n-api.service[125531]: method: > Oct 19 00:50:25.347900 dv-cinder-master-3-smb devstack@n-api.service[125531]: exception: Instance 99261375-5957-4ed8-b990-7c74ef5d7557 could not be found. Oct 19 00:50:25.347900 dv-cinder-master-3-smb devstack@n-api.service[125531]: action_args: {'id': '99261375-5957-4ed8-b990-7c74ef5d7557'} Oct 19 00:50:25.348991 dv-cinder-master-3-smb devstack@n-api.service[125531]: {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:50:25.348991 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:25.348991 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:50:25.348991 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:50:25.348991 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:50:25.348991 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:50:25.348991 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:50:25.348991 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:50:25.348991 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:50:25.348991 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:50:25.348991 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99261375-5957-4ed8-b990-7c74ef5d7557 could not be found. Oct 19 00:50:25.348991 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:50:25.348991 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:25.348991 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:50:25.348991 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:25.348991 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:25.348991 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:25.348991 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:50:25.348991 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:50:25.348991 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:50:25.350547 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:50:25.350547 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:50:25.350547 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:50:25.350547 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:50:25.350547 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:50:25.350547 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:50:25.350547 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:50:25.350547 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99261375-5957-4ed8-b990-7c74ef5d7557 could not be found. Oct 19 00:50:25.350547 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:50:25.350547 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:25.350547 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:50:25.350547 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:25.350547 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:25.350547 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:25.350547 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:50:25.350547 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:50:25.350547 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99261375-5957-4ed8-b990-7c74ef5d7557 could not be found. Oct 19 00:50:25.350547 dv-cinder-master-3-smb devstack@n-api.service[125531]: ERROR nova.api.openstack.wsgi Oct 19 00:50:25.352005 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-dcccb599-c049-4327-b93e-b72d713e7236 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] Returning 404 to user: Instance 99261375-5957-4ed8-b990-7c74ef5d7557 could not be found. {{(pid=125531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:50:25.352005 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-dcccb599-c049-4327-b93e-b72d713e7236 tempest-VolumesActionsTest-628319386 tempest-VolumesActionsTest-628319386-project] 10.222.0.33 "GET /compute/v2.1/servers/99261375-5957-4ed8-b990-7c74ef5d7557" status: 404 len: 111 microversion: 2.1 time: 0.031730 Oct 19 00:50:25.352005 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 543/1102] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:25 2022] GET /compute/v2.1/servers/99261375-5957-4ed8-b990-7c74ef5d7557 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 00:50:48.537231 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-2932ff09-cac2-498e-90bd-b53be23a9e23 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:48.538281 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-2932ff09-cac2-498e-90bd-b53be23a9e23 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:48.541166 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:48.541812 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG dbcounter [-] [125532] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125532) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:48.545948 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_api:SELECT=7 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:48.547390 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG dbcounter [-] [125531] Writing DB stats nova_cell1:SELECT=15 {{(pid=125531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:48.550543 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2932ff09-cac2-498e-90bd-b53be23a9e23 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:48.551731 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2932ff09-cac2-498e-90bd-b53be23a9e23 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:48.552426 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2932ff09-cac2-498e-90bd-b53be23a9e23 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:48.553200 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2932ff09-cac2-498e-90bd-b53be23a9e23 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:48.553933 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2932ff09-cac2-498e-90bd-b53be23a9e23 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:48.554545 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-2932ff09-cac2-498e-90bd-b53be23a9e23 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:48.583342 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-2932ff09-cac2-498e-90bd-b53be23a9e23 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Going to try to terminate instance {{(pid=125532) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:50:48.677058 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-2932ff09-cac2-498e-90bd-b53be23a9e23 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 204 len: 0 microversion: 2.1 time: 0.143081 Oct 19 00:50:48.678683 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 560/1103] 10.222.0.33 () {58 vars in 1239 bytes} [Wed Oct 19 00:50:48 2022] DELETE /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:50:48.688244 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-74ac99c1-4bd8-48db-96ef-b2ad27f6b019 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:48.688998 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-74ac99c1-4bd8-48db-96ef-b2ad27f6b019 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:48.697413 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-74ac99c1-4bd8-48db-96ef-b2ad27f6b019 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:48.698129 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-74ac99c1-4bd8-48db-96ef-b2ad27f6b019 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:48.698783 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-74ac99c1-4bd8-48db-96ef-b2ad27f6b019 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:48.699534 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-74ac99c1-4bd8-48db-96ef-b2ad27f6b019 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:48.700040 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-74ac99c1-4bd8-48db-96ef-b2ad27f6b019 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:48.700527 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-74ac99c1-4bd8-48db-96ef-b2ad27f6b019 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:48.798658 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [req-553b402b-7b69-4bcd-9ca5-779cc2eb89c3 req-8d3bec9f-cf6b-46d0-8d9b-03fc977fb3e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a4f60d9-b884-40cb-a416-b34e456f77e9", "tag": "8d31d467-6029-44f7-b3e8-25183019299e"}]} {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:48.810667 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-553b402b-7b69-4bcd-9ca5-779cc2eb89c3 req-8d3bec9f-cf6b-46d0-8d9b-03fc977fb3e0 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:48.811341 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-553b402b-7b69-4bcd-9ca5-779cc2eb89c3 req-8d3bec9f-cf6b-46d0-8d9b-03fc977fb3e0 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:48.811950 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [req-553b402b-7b69-4bcd-9ca5-779cc2eb89c3 req-8d3bec9f-cf6b-46d0-8d9b-03fc977fb3e0 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:48.823785 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.compute.server_external_events [req-553b402b-7b69-4bcd-9ca5-779cc2eb89c3 req-8d3bec9f-cf6b-46d0-8d9b-03fc977fb3e0 service nova] Creating event network-changed:8d31d467-6029-44f7-b3e8-25183019299e for instance 6a4f60d9-b884-40cb-a416-b34e456f77e9 on hv-cinder-maste Oct 19 00:50:48.829157 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [req-553b402b-7b69-4bcd-9ca5-779cc2eb89c3 req-8d3bec9f-cf6b-46d0-8d9b-03fc977fb3e0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.288326 Oct 19 00:50:48.830083 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 544/1104] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:48.870021 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.policy [None req-74ac99c1-4bd8-48db-96ef-b2ad27f6b019 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125532) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:48.878546 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-74ac99c1-4bd8-48db-96ef-b2ad27f6b019 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1567 microversion: 2.1 time: 0.195502 Oct 19 00:50:48.879111 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 561/1105] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:48 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1567 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:50:49.902911 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-33f17884-8402-4bb5-8240-527c869cfcf5 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:49.903606 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-33f17884-8402-4bb5-8240-527c869cfcf5 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:49.909959 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-33f17884-8402-4bb5-8240-527c869cfcf5 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:49.910437 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-33f17884-8402-4bb5-8240-527c869cfcf5 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:49.910866 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-33f17884-8402-4bb5-8240-527c869cfcf5 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:49.911553 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-33f17884-8402-4bb5-8240-527c869cfcf5 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:49.912029 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-33f17884-8402-4bb5-8240-527c869cfcf5 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:49.912446 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-33f17884-8402-4bb5-8240-527c869cfcf5 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:50.053287 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-33f17884-8402-4bb5-8240-527c869cfcf5 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:50.061186 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-33f17884-8402-4bb5-8240-527c869cfcf5 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1567 microversion: 2.1 time: 0.163054 Oct 19 00:50:50.062386 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 545/1106] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:49 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:50.906062 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [req-1f7a0d96-9010-4352-933e-4d86d82f94bd req-f08aec77-c502-4aca-b0d1-0f563ce6b3e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a4f60d9-b884-40cb-a416-b34e456f77e9", "name": "network-vif-deleted", "tag": "8d31d467-6029-44f7-b3e8-25183019299e"}]} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:50.916444 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-1f7a0d96-9010-4352-933e-4d86d82f94bd req-f08aec77-c502-4aca-b0d1-0f563ce6b3e3 service nova] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:50.916925 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-1f7a0d96-9010-4352-933e-4d86d82f94bd req-f08aec77-c502-4aca-b0d1-0f563ce6b3e3 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:50.917353 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [req-1f7a0d96-9010-4352-933e-4d86d82f94bd req-f08aec77-c502-4aca-b0d1-0f563ce6b3e3 service nova] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:50.928625 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.compute.server_external_events [req-1f7a0d96-9010-4352-933e-4d86d82f94bd req-f08aec77-c502-4aca-b0d1-0f563ce6b3e3 service nova] Creating event network-vif-deleted:8d31d467-6029-44f7-b3e8-25183019299e for instance 6a4f60d9-b884-40cb-a416-b34e456f77e9 on hv-cinder-maste Oct 19 00:50:50.933631 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [req-1f7a0d96-9010-4352-933e-4d86d82f94bd req-f08aec77-c502-4aca-b0d1-0f563ce6b3e3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031369 Oct 19 00:50:50.934300 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 562/1107] 10.222.0.33 () {64 vars in 1317 bytes} [Wed Oct 19 00:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:51.084906 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-66756ac3-3814-426e-9c4b-5bf5a77db8fb tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:51.085446 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.compute.api [None req-66756ac3-3814-426e-9c4b-5bf5a77db8fb tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125531) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:51.093937 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-66756ac3-3814-426e-9c4b-5bf5a77db8fb tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:51.094498 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-66756ac3-3814-426e-9c4b-5bf5a77db8fb tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:51.095205 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-66756ac3-3814-426e-9c4b-5bf5a77db8fb tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:51.096101 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-66756ac3-3814-426e-9c4b-5bf5a77db8fb tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:51.096771 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-66756ac3-3814-426e-9c4b-5bf5a77db8fb tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:51.097727 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG oslo_concurrency.lockutils [None req-66756ac3-3814-426e-9c4b-5bf5a77db8fb tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:51.166257 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.policy [None req-66756ac3-3814-426e-9c4b-5bf5a77db8fb tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3fe41c82b4844f8a4d38bd83206215a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f43c385ec4522b38cc84d00bef279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125531) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:51.176310 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-66756ac3-3814-426e-9c4b-5bf5a77db8fb tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 200 len: 1218 microversion: 2.1 time: 0.095237 Oct 19 00:50:51.177001 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 546/1108] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:51 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:52.201460 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-8ad87362-3afc-4904-91d6-c9db38829bfb tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:52.202191 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.compute.api [None req-8ad87362-3afc-4904-91d6-c9db38829bfb tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] [instance: 6a4f60d9-b884-40cb-a416-b34e456f77e9] Fetching instance by UUID {{(pid=125532) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:52.208523 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8ad87362-3afc-4904-91d6-c9db38829bfb tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:52.209001 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8ad87362-3afc-4904-91d6-c9db38829bfb tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:52.209434 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8ad87362-3afc-4904-91d6-c9db38829bfb tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:52.210119 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8ad87362-3afc-4904-91d6-c9db38829bfb tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Acquiring lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:52.210574 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8ad87362-3afc-4904-91d6-c9db38829bfb tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:52.210999 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-8ad87362-3afc-4904-91d6-c9db38829bfb tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Lock "1cbbfd13-0a9e-4a7c-bd25-f1623c90a5ab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:52.224020 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.wsgi [None req-8ad87362-3afc-4904-91d6-c9db38829bfb tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] HTTP exception thrown: Instance 6a4f60d9-b884-40cb-a416-b34e456f77e9 could not be found. Oct 19 00:50:52.225624 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-8ad87362-3afc-4904-91d6-c9db38829bfb tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Request method failure captured: Oct 19 00:50:52.225624 dv-cinder-master-3-smb devstack@n-api.service[125532]: request: GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 HTTP/1.1 Oct 19 00:50:52.225624 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept: application/json Oct 19 00:50:52.225624 dv-cinder-master-3-smb devstack@n-api.service[125532]: Accept-Encoding: identity Oct 19 00:50:52.225624 dv-cinder-master-3-smb devstack@n-api.service[125532]: Connection: close Oct 19 00:50:52.225624 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Length: 0 Oct 19 00:50:52.225624 dv-cinder-master-3-smb devstack@n-api.service[125532]: Content-Type: application/json Oct 19 00:50:52.225624 dv-cinder-master-3-smb devstack@n-api.service[125532]: Host: 10.222.0.33 Oct 19 00:50:52.225624 dv-cinder-master-3-smb devstack@n-api.service[125532]: Openstack-System-Scope: None Oct 19 00:50:52.225624 dv-cinder-master-3-smb devstack@n-api.service[125532]: User-Agent: python-urllib3/1.26.12 Oct 19 00:50:52.225624 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Auth-Token: gAAAAABjT0iZUT6tuJ3SMSTDuD10TY9AqSCGv1ez1Ou1oC9v5sianbd9A3fYSWKoGsPnVjNFhKxzOEuJAu5Sw-bNb152EUIl5CXNlBdnPgAfHZ5GeFk7NO4EYR6Rgt1cwAeugGr10iCwn1DjWtC6yjMpZEp2DUkydme_OoRbZWTSIJ9gJpPSCvQ Oct 19 00:50:52.225624 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Id: None Oct 19 00:50:52.225624 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Domain-Name: None Oct 19 00:50:52.225624 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Identity-Status: Confirmed Oct 19 00:50:52.225624 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Is-Admin-Project: True Oct 19 00:50:52.225624 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Id: default Oct 19 00:50:52.225624 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Domain-Name: Default Oct 19 00:50:52.225624 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Id: a98f43c385ec4522b38cc84d00bef279 Oct 19 00:50:52.225624 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Project-Name: tempest-TestShelveInstance-313514631 Oct 19 00:50:52.225624 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Role: member,reader Oct 19 00:50:52.225624 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Roles: member,reader Oct 19 00:50:52.227315 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a98f43c385ec4522b38cc84d00bef279"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a98f43c385ec4522b38cc84d00bef279"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a98f43c385ec4522b38cc84d00bef279"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a98f43c385ec4522b38cc84d00bef279"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Oct 19 00:50:52.227315 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant: tempest-TestShelveInstance-313514631 Oct 19 00:50:52.227315 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Id: a98f43c385ec4522b38cc84d00bef279 Oct 19 00:50:52.227315 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-Tenant-Name: tempest-TestShelveInstance-313514631 Oct 19 00:50:52.227315 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User: tempest-TestShelveInstance-313514631-project Oct 19 00:50:52.227315 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Id: default Oct 19 00:50:52.227315 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Domain-Name: Default Oct 19 00:50:52.227315 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Id: a3fe41c82b4844f8a4d38bd83206215a Oct 19 00:50:52.227315 dv-cinder-master-3-smb devstack@n-api.service[125532]: X-User-Name: tempest-TestShelveInstance-313514631-project Oct 19 00:50:52.227315 dv-cinder-master-3-smb devstack@n-api.service[125532]: method: > Oct 19 00:50:52.227315 dv-cinder-master-3-smb devstack@n-api.service[125532]: exception: Instance 6a4f60d9-b884-40cb-a416-b34e456f77e9 could not be found. Oct 19 00:50:52.227315 dv-cinder-master-3-smb devstack@n-api.service[125532]: action_args: {'id': '6a4f60d9-b884-40cb-a416-b34e456f77e9'} Oct 19 00:50:52.228431 dv-cinder-master-3-smb devstack@n-api.service[125532]: {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:50:52.228431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:52.228431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:50:52.228431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:50:52.228431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:50:52.228431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:50:52.228431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:50:52.228431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:50:52.228431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:50:52.228431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:50:52.228431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a4f60d9-b884-40cb-a416-b34e456f77e9 could not be found. Oct 19 00:50:52.228431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:50:52.228431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:52.228431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:50:52.228431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:52.228431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:52.228431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:52.228431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:50:52.228431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:50:52.228431 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:50:52.230070 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:50:52.230070 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:50:52.230070 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:50:52.230070 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:50:52.230070 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:50:52.230070 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:50:52.230070 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:50:52.230070 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a4f60d9-b884-40cb-a416-b34e456f77e9 could not be found. Oct 19 00:50:52.230070 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:50:52.230070 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:52.230070 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:50:52.230070 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:52.230070 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:52.230070 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:52.230070 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:50:52.230070 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:50:52.230070 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a4f60d9-b884-40cb-a416-b34e456f77e9 could not be found. Oct 19 00:50:52.230070 dv-cinder-master-3-smb devstack@n-api.service[125532]: ERROR nova.api.openstack.wsgi Oct 19 00:50:52.231602 dv-cinder-master-3-smb devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-8ad87362-3afc-4904-91d6-c9db38829bfb tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Returning 404 to user: Instance 6a4f60d9-b884-40cb-a416-b34e456f77e9 could not be found. {{(pid=125532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:50:52.231602 dv-cinder-master-3-smb devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-8ad87362-3afc-4904-91d6-c9db38829bfb tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9" status: 404 len: 111 microversion: 2.1 time: 0.030270 Oct 19 00:50:52.231602 dv-cinder-master-3-smb devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 563/1109] 10.222.0.33 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:52 2022] GET /compute/v2.1/servers/6a4f60d9-b884-40cb-a416-b34e456f77e9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:50:52.386135 dv-cinder-master-3-smb devstack@n-api.service[125531]: DEBUG nova.api.openstack.wsgi [None req-a4967624-7572-4a4c-8323-56896ba20eb6 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] Calling method '.version_select at 0x7f81f108e940>' {{(pid=125531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:52.406608 dv-cinder-master-3-smb devstack@n-api.service[125531]: INFO nova.api.openstack.requestlog [None req-a4967624-7572-4a4c-8323-56896ba20eb6 tempest-TestShelveInstance-313514631 tempest-TestShelveInstance-313514631-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-161843090" status: 202 len: 0 microversion: 2.1 time: 0.024127 Oct 19 00:50:52.407351 dv-cinder-master-3-smb devstack@n-api.service[125531]: [pid: 125531|app: 0|req: 547/1110] 10.222.0.33 () {58 vars in 1251 bytes} [Wed Oct 19 00:50:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-161843090 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)